Skip to content
conftrace_

summarization evaluation

78 papers

Papers

LTRC_IIITH’s 2023 Submission for Prompting Large Language Models as Explainable Metrics Task AACL 2023 Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval EMNLP 2023 Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023 Reference-Free Summarization Evaluation with Large Language Models AACL 2023 Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation ACL 2023 RISE: Leveraging Retrieval Techniques for Summarization Evaluation ACL 2023 SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation EMNLP 2023 SMART: Sentences as Basic Units for Text Evaluation ICLR 2023 SummEdits: Measuring LLM Ability at Factual Reasoning Through The Lens of Summarization EMNLP 2023 The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics AACL 2023 Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization CoNLL 2023 TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models EMNLP 2023 UMSE: Unified Multi-scenario Summarization Evaluation ACL 2023 Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors ACL 2023 Understanding Large Language Model Based Metrics for Text Summarization AACL 2023 Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ACL 2022 DialSummEval: Revisiting Summarization Evaluation for Dialogues NAACL 2022 Does Summary Evaluation Survive Translation to Other Languages? NAACL 2022 FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation EMNLP 2022 InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation AAAI 2022 Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries NAACL 2022 Investigating Metric Diversity for Evaluating Long Document Summarisation COLING 2022 PrefScore: Pairwise Preference Learning for Reference-free Summarization Quality Assessment COLING 2022 QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization NAACL 2022 Questioning the Validity of Summarization Datasets and Improving Their Factual Consistency EMNLP 2022