automatic metric

What’s under the hood: Investigating Automatic Metrics on Meeting Summarization EMNLP 2024 BLESS: Benchmarking Large Language Models on Sentence Simplification EMNLP 2023 BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training ACL 2023 Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA EMNLP 2023 Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation ACL 2023 SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation EMNLP 2023 Toward Human-Like Evaluation for Natural Language Generation with Error Analysis ACL 2023 Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons ACL 2022 A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ACL 2022 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022 BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation NAACL 2022 Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset EMNLP 2022 Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ACL 2022 InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation AAAI 2022 Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation COLING 2022 Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems EMNLP 2022 Toward More Effective Human Evaluation for Machine Translation ACL 2022 Transparent Human Evaluation for Image Captioning NAACL 2022 A Fine-Grained Analysis of BERTScore EMNLP 2021 Evaluating Text Generation from Discourse Representation Structures ACL 2021 Evaluating the Evaluation of Diversity in Natural Language Generation EACL 2021 Finding a Balanced Degree of Automation for Summary Evaluation EMNLP 2021 Just Ask! Evaluating Machine Translation by Asking and Answering Questions EMNLP 2021 OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics ACL 2021 Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain EMNLP 2021