evaluation metric

SumPubMed: Summarization Dataset of PubMed Scientific Articles ACL 2021 The Acceptability Delta Criterion: Testing Knowledge of Language using the Gradience of Sentence Acceptability EMNLP 2021 The effectiveness of feature attribution methods and its correlation with automatic evaluation scores NeurIPS 2021 The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ACL 2021 The statistical advantage of automatic NLG metrics at the system level ACL 2021 Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR EACL 2021 Towards Objectively Evaluating the Quality of Generated Medical Summaries EACL 2021 Towards the evaluation of automatic simultaneous speech translation from a communicative perspective ACL 2021 UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning ACL 2021 Understanding the Extent to which Content Quality Metrics Measure the Information Quality of Summaries CoNLL 2021 Understanding the Impact of UGC Specificities on Translation Quality EMNLP 2021 We Need to Consider Disagreement in Evaluation ACL 2021 What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP EMNLP 2021 An Effectiveness Metric for Ordinal Classification: Formal Properties and Experimental Results ACL 2020 Are Some Words Worth More than Others? EMNLP 2020 Asking and Answering Questions to Evaluate the Factual Consistency of Summaries ACL 2020 A Sober Look at the Unsupervised Learning of Disentangled Representations and their Evaluation JMLR 2020 Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale COLING 2020 Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems COLING 2020 Dscorer: A Fast Evaluation Metric for Discourse Representation Structure Parsing ACL 2020 Evaluating Natural Language Generation via Unbalanced Optimal Transport IJCAI 2020 Examining the State-of-the-Art in News Timeline Summarization ACL 2020 Facet-Aware Evaluation for Extractive Summarization ACL 2020 FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization ACL 2020 Fine-grained linguistic evaluation for state-of-the-art Machine Translation EMNLP 2020