Skip to content
conftrace_

safety benchmark

32 papers

Papers

AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions CVPR 2026 Evolving Contextual Safety in Multi-Modal Large Language Models via Inference-Time Self-Reflective Memory CVPR 2026 IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Tasks AAAI 2026 MedOmni-45°: A Safety–Performance Benchmark for Reasoning-Oriented LLMs in Medicine AAAI 2026 The Side Effects of Being Smart: Safety Risks in MLLMs’ Multi-Image Reasoning ACL 2026 R^2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning ICLR 2025 A Benchmark for Semantic Sensitive Information in LLMs Outputs ICLR 2025 Advancing Embodied Agent Security: From Safety Benchmarks to Input Moderation IJCAI 2025 AIR-BENCH 2024: A Safety Benchmark based on Regulation and Policies Specified Risk Categories ICLR 2025 AraSafe: Benchmarking Safety in Arabic LLMs EMNLP 2025 Are Bias Evaluation Methods Biased ? ACL 2025 Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation ACL 2025 Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models ACL 2025 IDEATOR: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselves ICCV 2025 Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models EMNLP 2025 JailbreakDiffBench: A Comprehensive Benchmark for Jailbreaking Diffusion Models ICCV 2025 Jailbreak Distillation: Renewable Safety Benchmarking EMNLP 2025 LongSafety: Evaluating Long-Context Safety of Large Language Models ACL 2025 MCIP: Protecting MCP Safety via Model Contextual Integrity Protocol EMNLP 2025 SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs EMNLP 2025 Six-CD: Benchmarking Concept Removals for Text-to-image Diffusion Models CVPR 2025 T2ISafety: Benchmark for Assessing Fairness, Toxicity, and Privacy in Image Generation CVPR 2025 Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore’s Low-Resource Languages EMNLP 2025 All Languages Matter: On the Multilingual Safety of LLMs ACL 2024 Detoxifying Large Language Models via Knowledge Editing ACL 2024