benchmark evaluation

Beyond Human Labels: A Multi-Linguistic Auto-Generated Benchmark for Evaluating Large Language Models on Resume Parsing EMNLP 2025 Beyond Perception: Evaluating Abstract Visual Reasoning through Multi-Stage Task ACL 2025 Beyond the Haystack: Sensitivity to Context in Legal Reference Recall EMNLP 2025 Beyond Visual Understanding Introducing PARROT-360V for Vision Language Model Benchmarking COLING 2025 BHRAM-IL: A Benchmark for Hallucination Recognition and Assessment in Multiple Indian Languages AACL 2025 Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluation ICCV 2025 Big Escape Benchmark: Evaluating Human-Like Reasoning in Language Models via Real-World Escape Room Challenges ACL 2025 Bilingual BSARD: Extending Statutory Article Retrieval to Dutch COLING 2025 Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination COLING 2025 BinMetric: A Comprehensive Binary Code Analysis Benchmark for Large Language Models IJCAI 2025 BioHopR: A Benchmark for Multi-Hop, Multi-Answer Reasoning in Biomedical Domain ACL 2025 Blind Men and the Elephant: Diverse Perspectives on Gender Stereotypes in Benchmark Datasets EMNLP 2025 Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM EMNLP 2025 B-REASO: A Multi-Level Multi-Faceted Bengali Evaluation Suite for Foundation Models EMNLP 2025 Bridging AI and Carbon Capture: A Dataset for LLMs in Ionic Liquids and CBE Research ACL 2025 Bridging the Gap with RedSQL: A Russian Text-to-SQL Benchmark for Domain-Specific Applications ACL 2025 BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval ICLR 2025 Browsing Lost Unformed Recollections: A Benchmark for Tip-of-the-Tongue Search and Reasoning ACL 2025 Burn After Reading: Do Multimodal Large Language Models Truly Capture Order of Events in Image Sequences? ACL 2025 C2LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation ACL 2025 CAMEL-Bench: A Comprehensive Arabic LMM Benchmark NAACL 2025 Can AI Validate Science? Benchmarking LLMs on Claim →Evidence Reasoning in AI Papers IJCNLP 2025 CANDY: Benchmarking LLMs’ Limitations and Assistive Potential in Chinese Misinformation Fact-Checking EMNLP 2025 Can Language Models Replace Programmers for Coding? REPOCOD Says ‘Not Yet’ ACL 2025 Can Large Language Models Be Good Language Teachers? EMNLP 2025