automated metrics

10 papers

Explore in graph

Co-occurring keywords

human evaluation (375) automated metric (10) summarization evaluation (84) evaluation metrics (195) large language model (12755) text summarization (889) text generation (2903) machine translation (2472) uncertainty quantification (1365) ambiguous question answering (4)

Papers

CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era ACL 2025

Real-World Summarization: When Evaluation Reaches Its Limits EMNLP 2025

COMET-poly: Machine Translation Metric Grounded in Other Candidates EMNLP 2025

Correction of Errors in Preference Ratings from Automated Metrics for Text Generation ACL 2023

Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023

On the Effectiveness of Automated Metrics for Text Generation Systems EMNLP 2022

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics IJCNLP 2021

Automated Pyramid Summarization Evaluation CONLL 2019

Identifying Sensible Lexical Relations in Generated Stories NAACL 2019

Automatic Reference-Based Evaluation of Pronoun Translation Misses the Point EMNLP 2018