automatic evaluation

DRAGOn: Designing RAG On Periodically Updated Corpus EACL 2026 I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Models CVPR 2026 MEDAL: A Framework for Benchmarking LLMs as Multilingual Open-Domain Dialogue Evaluators EACL 2026 MM-JudgeBias: A Benchmark for Evaluating Compositional Biases in MLLM-as-a-Judge ACL 2026 Process Evaluation for Agentic Systems EACL 2026 Validating Automatic Evaluation of Controllable Counterspeech Generation: Rankings Matter More Than Scores EACL 2026 ACE-M3: Automatic Capability Evaluator for Multimodal Medical Models COLING 2025 Adapting Sentence-level Automatic Metrics for Document-level Simplification Evaluation NAACL 2025 ALERT: An LLM-powered Benchmark for Automatic Evaluation of Recommendation Explanations NAACL 2025 Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation NAACL 2025 Are Checklists Really Useful for Automatic Evaluation of Generative Tasks? EMNLP 2025 ARGENT: Automatic Reference-free Evaluation for Open-Ended Text Generation without Source Inputs ACL 2025 Audio-Aware Large Language Models as Judges for Speaking Styles EMNLP 2025 Automatic Evaluation for Text-to-image Generation: Task-decomposed Framework, Distilled Training, and Meta-evaluation Benchmark ACL 2025 Automatic Evaluation of Language Generation Technology Based on Structure Alignment COLING 2025 AutoMedEval: Harnessing Language Models for Automatic Medical Capability Evaluation ACL 2025 Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions NAACL 2025 Beyond correlation: The impact of human uncertainty in measuring the effectiveness of automatic evaluation and LLM-as-a-judge ICLR 2025 Comparison-Based Automatic Evaluation for Meeting Summarization Interspeech 2025 Cross-lingual Evaluation of Multilingual Text Generation COLING 2025 D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Models ACL 2025 Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objects CVPR 2025 Help Me Write a Story: Evaluating LLMs’ Ability to Generate Writing Feedback ACL 2025 Hindi Reading Comprehension: Do Large Language Models Exhibit Semantic Understanding? COLING 2025 IMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator ACL 2025