Skip to content
conftrace_

adversarial evaluation

43 papers

Papers

Fine-Grained Multi Image Object Hallucination Benchmark CVPR 2026 Obedience or Vigilance? How Large Language Models React to Malicious Multiple-Choice Options (Student Abstract) AAAI 2026 A Black-Box Evaluation Framework for Semantic Robustness in Bird’s Eye View Detection AAAI 2025 Conflicting Needles in a Haystack: How LLMs behave when faced with contradictory information EMNLP 2025 Evaluating Implicit Bias in Large Language Models by Attacking From a Psychometric Perspective ACL 2025 Examining Multilingual Embedding Models Cross-Lingually Through LLM-Generated Adversarial Examples EMNLP 2025 GuessArena: Guess Who I Am? A Self-Adaptive Framework for Evaluating LLMs in Domain-Specific Knowledge and Reasoning ACL 2025 How does Misinformation Affect Large Language Model Behaviors and Preferences? ACL 2025 LLMs as Medical Safety Judges: Evaluating Alignment with Human Annotation in Patient-Facing QA ACL 2025 LLMs can be easily Confused by Instructional Distractions ACL 2025 MHBench: Demystifying Motion Hallucination in VideoLLMs AAAI 2025 PL-Guard: Benchmarking Language Model Safety for Polish ACL 2025 Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA ACL 2025 Beyond the Surface: Spurious Cues in Automatic Media Bias Detection EACL 2024 Don’t Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models ACL 2024 Flames: Benchmarking Value Alignment of LLMs in Chinese NAACL 2024 InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents ACL 2024 Mitigating Hallucination in Fictional Character Role-Play EMNLP 2024 NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samples NeurIPS 2024 No Regrets: Investigating and Improving Regret Approximations for Curriculum Discovery NeurIPS 2024 NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security NeurIPS 2024 Robust Code Summarization EMNLP 2023 SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality NeurIPS 2023 Testing Paraphrase Models on Recognising Sentence Pairs at Different Degrees of Semantic Overlap ACL 2023 Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks NAACL 2022