← Keywords

summarization evaluation

84 papers

Explore in graph

Co-occurring keywords

human evaluation (375) large language model (12755) text summarization (889) reference-free evaluation (88) evaluation metric (415) natural language inference (1278) rouge metric (25) text generation (2903) abstractive summarization (631) automatic evaluation (224)

Papers

Auto-PRE: An Automatic and Cost-Efficient Peer-Review Framework for Language Generation Evaluation AAAI 2026
ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation IJCNLP 2025
Spot the BlindSpots: Systematic Identification and Quantification of Fine-Grained LLM Biases in Contact Center Call Summarization EMNLP 2025
A Tale of Evaluating Factual Consistency: Case Study on Long Document Summarization Evaluation ACL 2025
Who Remembers What? Tracing Information Fidelity in Human-AI Chains IJCNLP 2025
Real-World Summarization: When Evaluation Reaches Its Limits EMNLP 2025
ReproHum #0067-01: A Reproduction of the Evaluation of Cross-Lingual Summarization ACL 2025
ReproHum #0729-04: Human Evaluation Reproduction Report for “MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes” ACL 2025
A Critical Look at Meta-evaluating Summarisation Evaluation Metrics EMNLP 2024
SummEQuAL: Summarization Evaluation via Question Answering using Large Language Models ACL 2024
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems EMNLP 2024
Mitigating the Impact of Reference Quality on Evaluation of Summarization Systems with Reference-Free Metrics EMNLP 2024
One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation ACL 2024
PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation EMNLP 2024
METAL: Towards Multilingual Meta-Evaluation NAACL 2024
UniSumEval: Towards Unified, Fine-grained, Multi-dimensional Summarization Evaluation for LLMs EMNLP 2024
ROUGE-K: Do Your Summaries Have Keywords? NAACL 2024
COSMIC: Mutual Information for Task-Agnostic Summarization Evaluation ACL 2024
Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023
Entity-Based Evaluation of Political Bias in Automatic Summarization EMNLP 2023
Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarization ACL 2023
LTRC_IIITH’s 2023 Submission for Prompting Large Language Models as Explainable Metrics Task AACL 2023
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation ACL 2023
RISE: Leveraging Retrieval Techniques for Summarization Evaluation ACL 2023
Understanding Large Language Model Based Metrics for Text Summarization IJCNLP 2023