Evaluation

Redundancy Principles for MLLMs Benchmarks ACL 2025 Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference NAACL 2025 Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QA EMNLP 2025 RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generation EMNLP 2025 REGen: A Reliable Evaluation Framework for Generative Event Argument Extraction EMNLP 2025 Reliability of Topic Modeling NAACL 2025 ReliableEval: A Recipe for Stochastic LLM Evaluation via Method of Moments EMNLP 2025 REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities ACL 2025 REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? ACL 2025 Reproducing the Argument Quality Prediction of Project Debater ACL 2025 ReproHum #0031-01: Reproducing the Human Evaluation of Readability from “It is AI’s Turn to Ask Humans a Question” ACL 2025 ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective ACL 2025 ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025 ReproHum #0729-04: Human Evaluation Reproduction Report for “MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes” ACL 2025 ReproHum #0744-02: A Reproduction of the Human Evaluation of Meaning Preservation in “Factorising Meaning and Form for Intent-Preserving Paraphrasing” ACL 2025 Response Wide Shut? Surprising Observations in Basic Vision Language Model Capabilities ACL 2025 Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human? ACL 2025 Rethinking Prompt-based Debiasing in Large Language Model ACL 2025 Rethinking Reward Model Evaluation Through the Lens of Reward Overoptimization ACL 2025 Rethinking the generalization of drug target affinity prediction algorithms via similarity aware evaluation ICLR 2025 Retrieval-Augmented Process Reward Model for Generalizable Mathematical Reasoning ACL 2025 Return of EM: Entity-driven Answer Set Expansion for QA Evaluation COLING 2025 Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playing EMNLP 2025 ReviewEval: An Evaluation Framework for AI-Generated Reviews EMNLP 2025 Revitalizing Saturated Benchmarks: A Weighted Metric Approach for Differentiating Large Language Model Performance NAACL 2025