metric correlation

A Measure of the System Dependence of Automated Metrics ACL 2025 Effects of automatic alignment on speech translation metrics ACL 2025 Can Automatic Metrics Assess High-Quality Translations? EMNLP 2024 Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In! ACL 2024 How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages? ACL 2024 Meta-Evaluation of Sentence Simplification Metrics COLING 2024 Why Don’t Prompt-Based Fairness Metrics Correlate? ACL 2024 MT Metrics Correlate with Human Ratings of Simultaneous Speech Translation ACL 2023 Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023 Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent EMNLP 2023 Assessing Inter-metric Correlation for Multi-document Summarization Evaluation EMNLP 2022 Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation ACL 2022 Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ACL 2022 Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation COLING 2022 [RETRACTED] NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation COLING 2022 Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain EMNLP 2021 To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation EMNLP 2021 Human-Paraphrased References Improve Neural Machine Translation EMNLP 2020 Multi-Hypothesis Machine Translation Evaluation ACL 2020 SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics EMNLP 2020 Towards a Better Evaluation of Metrics for Machine Translation EMNLP 2020 Studying Summarization Evaluation Metrics in the Appropriate Scoring Range ACL 2019 Re-evaluating Automatic Metrics for Image Captioning EACL 2017