summarization evaluation

Reference-free Summarization Evaluation via Semantic Correlation and Compression Ratio NAACL 2022 Revisiting text decomposition methods for NLI-based factuality scoring of summaries EMNLP 2022 SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale EMNLP 2022 SNaC: Coherence Error Detection for Narrative Summarization EMNLP 2022 SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling NAACL 2022 A Training-free and Reference-free Summarization Evaluation Metric via Centrality-weighted Relevance and Self-referenced Redundancy ACL 2021 Automatic Text Evaluation through the Lens of Wasserstein Barycenters EMNLP 2021 ESTIME: Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings EMNLP 2021 Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021 Finding a Balanced Degree of Automation for Summary Evaluation EMNLP 2021 Fine-grained Factual Consistency Assessment for Abstractive Summarization Models EMNLP 2021 How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluation EACL 2021 QuestEval: Summarization Asks for Fact-based Evaluation EMNLP 2021 Best Practices for Crowd-based Evaluation of German Summarization: Comparing Crowd, Expert and Automatic Evaluation EMNLP 2020 HOLMS: Alternative Summary Evaluation with Large Language Models COLING 2020 Metrics also Disagree in the Low Scoring Range: Revisiting Summarization Evaluation Metrics COLING 2020 SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics EMNLP 2020 Truth or Error? Towards systematic analysis of factual errors in abstractive summaries EMNLP 2020 Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning EMNLP 2020 Answers Unite! Unsupervised Metrics for Reinforced Summarization Models EMNLP 2019 Automated Pyramid Summarization Evaluation CoNLL 2019 HighRES: Highlight-based Reference-less Evaluation of Summarization ACL 2019 Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language Inference ACL 2019 Studying Summarization Evaluation Metrics in the Appropriate Scoring Range ACL 2019 The Feasibility of Embedding Based Automatic Evaluation for Single Document Summarization EMNLP 2019