metric evaluation

Large-Scale Correlation Analysis of Automated Metrics for Topic Models ACL 2023 NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist ACL 2023 Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks EMNLP 2023 Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level EMNLP 2023 A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ACL 2022 DialSummEval: Revisiting Summarization Evaluation for Dialogues NAACL 2022 Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics ACL 2022 Measuring Fairness with Biased Rulers: A Comparative Study on Bias Metrics for Pre-trained Language Models NAACL 2022 Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora EMNLP 2022 Relevance in Dialogue: Is Less More? An Empirical Comparison of Existing Metrics, and a Novel Simple Metric ACL 2022 Rethinking Knowledge Graph Evaluation Under the Open-World Assumption NeurIPS 2022 Towards Driving-Oriented Metric for Lane Detection Models CVPR 2022 Vacillating Human Correlation of SacreBLEU in Unprotected Languages ACL 2022 Are Factuality Checkers Reliable? Adversarial Meta-evaluation of Factuality in Summarization EMNLP 2021 OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics ACL 2021 Perturbation CheckLists for Evaluating NLG Evaluation Metrics EMNLP 2021 SemBleu: A Robust Metric for AMR Parsing Evaluation ACL 2019 A Dataset for Benchmarking Image-Based Localization CVPR 2017 Better Evaluation of ASR in Speech Translation Context Using Word Embeddings Interspeech 2016