benchmark evaluation

Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance EMNLP 2025 Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning NAACL 2025 Arena-lite: Efficient and Reliable Large Language Model Evaluation via Tournament-Based Direct Comparisons EMNLP 2025 Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral ACL 2025 Are Small Language Models Ready to Compete with Large Language Models for Practical Applications? NAACL 2025 Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study EMNLP 2025 Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data and Metric Perspectives ICCV 2025 Are We Done with MMLU? NAACL 2025 Asclepius: A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models ACL 2025 A-SEA3𝐋-QA: A Fully Automated Self-Evolving, Adversarial Workflow for Arabic Long-Context Question-Answer Generation EMNLP 2025 AssertionBench: A Benchmark to Evaluate Large-Language Models for Assertion Generation NAACL 2025 Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks ACL 2025 Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluation EMNLP 2025 Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problems AAAI 2025 Assessing Visually-Continuous Corruption Robustness of Neural Networks Relative to Human Performance WACV 2025 AssoCiAm: A Benchmark for Evaluating Association Thinking while Circumventing Ambiguity EMNLP 2025 A Systematic Analysis of Base Model Choice for Reward Modeling EMNLP 2025 Audio-centric Video Understanding Benchmark without Text Shortcut EMNLP 2025 Automated Evaluation of Large Vision-Language Models on Self-Driving Corner Cases WACV 2025 Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation CVPR 2025 Autonomous Evaluation of LLMs for Truth Maintenance and Reasoning Tasks ICLR 2025 AutoPenBench: A Vulnerability Testing Benchmark for Generative Agents EMNLP 2025 AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists EMNLP 2025 AVHBench: A Cross-Modal Hallucination Benchmark for Audio-Visual Large Language Models ICLR 2025 Awes, Laws, and Flaws From Today’s LLM Research ACL 2025