automatic evaluation metric

CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systems COLING 2025 Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy NAACL 2025 VELA: An LLM-Hybrid-as-a-Judge Approach for Evaluating Long Image Captions EMNLP 2025 How Grammatical Features Impact Machine Translation: A New Test Suite for Chinese-English MT Evaluation EMNLP 2024 LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation COLING 2024 Rethinking Efficient Multilingual Text Summarization Meta-Evaluation ACL 2024 STORYSUMM: Evaluating Faithfulness in Story Summarization EMNLP 2024 Using Large Language Models to Evaluate Biomedical Query-Focused Summarisation ACL 2024 An Investigation of Evaluation Methods in Automatic Medical Note Generation ACL 2023 Gender Biases in Automatic Evaluation Metrics for Image Captioning EMNLP 2023 JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models CoNLL 2023 Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023 Towards Interpretable and Efficient Automatic Reference-Based Summarization Evaluation EMNLP 2023 DEAM: Dialogue Coherence Evaluation using AMR-based Semantic Manipulations ACL 2022 FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022 IMPARA: Impact-Based Metric for GEC Using Parallel Data COLING 2022 InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation AAAI 2022 MDD-Eval: Self-Training on Augmented Data for Multi-Domain Dialogue Evaluation AAAI 2022 A Comprehensive Assessment of Dialog Evaluation Metrics EMNLP 2021 Code to Comment Translation: A Comparative Study on Model Effectiveness & Errors ACL 2021 Difficulty-Aware Machine Translation Evaluation ACL 2021 Entity-Based Semantic Adequacy for Data-to-Text Generation EMNLP 2021 Improving Factual Consistency of Abstractive Summarization via Question Answering ACL 2021 An Anchor-Based Automatic Evaluation Metric for Document Summarization COLING 2020 Asking and Answering Questions to Evaluate the Factual Consistency of Summaries ACL 2020