conftrace_

automated metric

15 papers

Explore in graph

Co-occurring keywords · papers mentioning both

human evaluation (6) evaluation metric (4) large language model (3) summarization evaluation (3) text summarization (3) text generation (3) machine translation (3) text generation evaluation (2) automated evaluation (2) image captioning (2)

Papers

A Measure of the System Dependence of Automated Metrics ACL 2025 CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era ACL 2025 COMET-poly: Machine Translation Metric Grounded in Other Candidates EMNLP 2025 NovAScore: A New Automated Metric for Evaluating Document Level Novelty COLING 2025 Real-World Summarization: When Evaluation Reaches Its Limits EMNLP 2025 Text Style Transfer Evaluation Using Large Language Models COLING 2024 Correction of Errors in Preference Ratings from Automated Metrics for Text Generation ACL 2023 Dialect-robust Evaluation of Generated Text ACL 2023 Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023 On the Effectiveness of Automated Metrics for Text Generation Systems EMNLP 2022 SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale EMNLP 2022 Automated Pyramid Summarization Evaluation CoNLL 2019 Identifying Sensible Lexical Relations in Generated Stories NAACL 2019 Automatic Reference-Based Evaluation of Pronoun Translation Misses the Point EMNLP 2018 CIDEr: Consensus-Based Image Description Evaluation CVPR 2015