Evaluation

As easy as PIE: understanding when pruning causes language models to disagree NAACL 2025 A Simple and Comprehensive Benchmark for Single-Cell Transcriptomics AAAI 2025 Ask Me Like I’m Human: LLM-based Evaluation with For-Human Instructions Correlates Better with Human Evaluations than Human Judges ACL 2025 ASR-FAIRBENCH: Measuring and Benchmarking Equity Across Speech Recognition Systems Interspeech 2025 Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks ACL 2025 Assessing the Reliability and Validity of GPT-4 in Annotating Emotion Appraisal Ratings NAACL 2025 Assessing the Sensitivity and Alignment of FOL Closeness Metrics EMNLP 2025 Assessing Visually-Continuous Corruption Robustness of Neural Networks Relative to Human Performance WACV 2025 AssoCiAm: A Benchmark for Evaluating Association Thinking while Circumventing Ambiguity EMNLP 2025 A Statistical and Multi-Perspective Revisiting of the Membership Inference Attack in Large Language Models ACL 2025 A Tale of Evaluating Factual Consistency: Case Study on Long Document Summarization Evaluation ACL 2025 A Theoretical Framework for Evaluating Narrative Surprise in Large Language Models NAACL 2025 Audio-Based Crowd-Sourced Evaluation of Machine Translation Quality EMNLP 2025 A Unified Evaluation Framework for Epistemic Predictions AISTATS 2025 A Unified Interpretation of Training-Time Out-of-Distribution Detection ICCV 2025 A Unifying Information-theoretic Perspective on Evaluating Generative Models AAAI 2025 Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation CVPR 2025 Automated Model Evaluation for Object Detection via Prediction Consistency and Reliability ICCV 2025 AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists EMNLP 2025 AveniBench: Accessible and Versatile Evaluation of Finance Intelligence COLING 2025 Awes, Laws, and Flaws From Today’s LLM Research ACL 2025 Background Invariance Testing According to Semantic Proximity ICCV 2025 BanStereoSet: A Dataset to Measure Stereotypical Social Biases in LLMs for Bangla ACL 2025 BasqBBQ: A QA Benchmark for Assessing Social Biases in LLMs for Basque, a Low-Resource Language COLING 2025 Batched Self-Consistency Improves LLM Relevance Assessment and Ranking EMNLP 2025