summary evaluation

Discourse-Driven Evaluation: Unveiling Factual Inconsistency in Long Document Summarization NAACL 2025 Event-based evaluation of abstractive news summarization ACL 2025 Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluation NAACL 2025 Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Tasks EACL 2024 Less is More for Long Document Summary Evaluation by LLMs EACL 2024 Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs EMNLP 2023 A Study on Annotation Interfaces for Summary Comparison ACL 2023 Multi-View Source Ablation for Faithful Summarization EACL 2023 Play the Shannon Game with Language Models: A Human-Free Approach to Summary Evaluation AAAI 2022 Revisiting text decomposition methods for NLI-based factuality scoring of summaries EMNLP 2022 What Makes a Good and Useful Summary? Incorporating Users in Automatic Summarization Research NAACL 2022 ESTIME: Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings EMNLP 2021 Finding a Balanced Degree of Automation for Summary Evaluation EMNLP 2021 Facet-Aware Evaluation for Extractive Summarization ACL 2020 Fact-based Content Weighting for Evaluating Abstractive Summarisation ACL 2020 FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization ACL 2020 Analysing Rhetorical Structure as a Key Feature of Summary Coherence ACL 2019 Crowdsourcing Lightweight Pyramids for Manual Summary Evaluation NAACL 2019 Estimating Summary Quality with Pairwise Preferences NAACL 2018 Pruning Basic Elements for Better Automatic Evaluation of Summaries NAACL 2018