conftrace_

safety benchmark

27 papers

Explore in graph

Co-occurring keywords

large language model (13587) safety evaluation (94) ai safety (235) benchmark evaluation (1556) jailbreak attack (225) diffusion model (3751) llm safety (67) safety vulnerability (11) multilingual safety (11) language model safety (14)

Papers

The Side Effects of Being Smart: Safety Risks in MLLMs’ Multi-Image Reasoning ACL 2026
IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Tasks AAAI 2026
MedOmni-45°: A Safety–Performance Benchmark for Reasoning-Oriented LLMs in Medicine AAAI 2026
LongSafety: Evaluating Long-Context Safety of Large Language Models ACL 2025
Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation ACL 2025
Are Bias Evaluation Methods Biased ? ACL 2025
IDEATOR: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselves ICCV 2025
AraSafe: Benchmarking Safety in Arabic LLMs EMNLP 2025
MCIP: Protecting MCP Safety via Model Contextual Integrity Protocol EMNLP 2025
Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore’s Low-Resource Languages EMNLP 2025
T2ISafety: Benchmark for Assessing Fairness, Toxicity, and Privacy in Image Generation CVPR 2025
JailbreakDiffBench: A Comprehensive Benchmark for Jailbreaking Diffusion Models ICCV 2025
Six-CD: Benchmarking Concept Removals for Text-to-image Diffusion Models CVPR 2025
Advancing Embodied Agent Security: From Safety Benchmarks to Input Moderation IJCAI 2025
Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models ACL 2025
Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models EMNLP 2025
SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs EMNLP 2025
Jailbreak Distillation: Renewable Safety Benchmarking EMNLP 2025
JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models NIPS 2024
Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? NIPS 2024
Detoxifying Large Language Models via Knowledge Editing ACL 2024
T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models NIPS 2024
All Languages Matter: On the Multilingual Safety of LLMs ACL 2024
WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language Models EMNLP 2024
SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models ACL 2024