Evaluation

Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy NAACL 2025 Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models COLING 2025 Controlling Equational Reasoning in Large Language Models with Prompt Interventions AAAI 2025 CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025 Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia NAACL 2025 Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models ACL 2025 Cross-Validated Off-Policy Evaluation AAAI 2025 Cross Validation for Correlated Data in Classification Models AISTATS 2025 Current Semantic-change Quantification Methods Struggle with Discovery in the Wild EMNLP 2025 DASH: Detection and Assessment of Systematic Hallucinations of VLMs ICCV 2025 DCR: Quantifying Data Contamination in LLMs Evaluation EMNLP 2025 DecepBench: Benchmarking Multimodal Deception Detection ACL 2025 Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Models EMNLP 2025 Defining and Quantifying Visual Hallucinations in Vision-Language Models NAACL 2025 Demystifying Synthetic Data in LLM Pre-training: A Systematic Study of Scaling Laws, Benefits, and Pitfalls EMNLP 2025 Dense Retrievers Can Fail on Simple Queries: Revealing The Granularity Dilemma of Embeddings EMNLP 2025 DependEval: Benchmarking LLMs for Repository Dependency Understanding ACL 2025 Deploying Tiny LVLM Judges for Real-World Evaluation of Chart Models: Lessons Learned and Best Practices EMNLP 2025 D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Models ACL 2025 DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues ACL 2025 Difficulty Estimation in Natural Language Tasks with Action Scores NAACL 2025 DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management EMNLP 2025 Discriminative ordering through ensemble consensus UAI 2025 Disentangling Language and Culture for Evaluating Multilingual Large Language Models ACL 2025 DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models EMNLP 2025