automatic evaluation

Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judge ACL 2025 InspectorRAGet: An Introspection Platform for RAG Evaluation NAACL 2025 InstaJudge: Aligning Judgment Bias of LLM-as-Judge with Humans in Industry Applications EMNLP 2025 Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning? ACL 2025 K-NLPers at BEA 2025 Shared Task: Evaluating the Quality of AI Tutor Responses with GPT-4.1 ACL 2025 LAiW: A Chinese Legal Large Language Models Benchmark COLING 2025 L-CiteEval: A Suite for Evaluating Fidelity of Long-context Models ACL 2025 MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generation ACL 2025 MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models ICLR 2025 MSLC25: Metric Performance on Low-Quality Machine Translation, Empty Strings, and Language Variants EMNLP 2025 Multi-agentMT: Deploying AI Agent in the WMT25 Shared Task EMNLP 2025 Open-World Evaluation for Retrieving Diverse Perspectives NAACL 2025 RAG-Critic: Leveraging Automated Critic-Guided Agentic Workflow for Retrieval Augmented Generation ACL 2025 Readability Reconsidered A Cross-Dataset Analysis of Reference-Free Metrics EMNLP 2025 Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference NAACL 2025 Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QA EMNLP 2025 RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generation EMNLP 2025 SEARA: An Automated Approach for Obtaining Optimal Retrievers EMNLP 2025 Towards a Holistic and Automated Evaluation Framework for Multi-Level Comprehension of LLMs in Book-Length Contexts EMNLP 2025 Towards Automatic Evaluation for Image Transcreation NAACL 2025 Towards Better Evaluation for Generated Patent Claims ACL 2025 Up to Par? MT Systems Take a Shot at Sports Terminology EMNLP 2025 VELA: An LLM-Hybrid-as-a-Judge Approach for Evaluating Long Image Captions EMNLP 2025 What Matters in Evaluating Book-Length Stories? A Systematic Study of Long Story Evaluation ACL 2025 WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild ICLR 2025