automated evaluation

Learning to Align Multi-Faceted Evaluation: A Unified and Robust Framework ACL 2025 LogiDebrief: A Signal-Temporal Logic Based Automated Debriefing Approach with Large Language Models Integration IJCAI 2025 ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation ACL 2025 ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering ACL 2025 RocketEval: Efficient automated LLM evaluation via grading checklist ICLR 2025 TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding ACL 2025 Towards Scalable Human-aligned Benchmark for Text-guided Image Editing CVPR 2025 (Towards) Scalable Reliable Automated Evaluation with Large Language Models ACL 2025 VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation CVPR 2025 xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation ICLR 2025 APPLS: Evaluating Evaluation Metrics for Plain Language Summarization EMNLP 2024 AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models EMNLP 2024 AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models EMNLP 2024 Automated Evaluation of Teacher Encouragement of Student-to-Student Interactions in a Simulated Classroom Discussion NAACL 2024 Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards EMNLP 2024 FineSurE: Fine-grained Summarization Evaluation using LLMs ACL 2024 LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts ACL 2024 Long-form factuality in large language models NeurIPS 2024 QualEval: Qualitative Evaluation for Model Improvement NAACL 2024 Refining App Reviews: Dataset, Methodology, and Evaluation EMNLP 2024 Revisiting Automated Evaluation for Long-form Table Question Answering EMNLP 2024 Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations ACL 2023 IC3: Image Captioning by Committee Consensus EMNLP 2023 Open-Domain Dialog Evaluation Using Follow-Ups Likelihood COLING 2022 SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale EMNLP 2022