Co-occurring keywords · papers mentioning both
Papers
LTRC_IIITH’s 2023 Submission for Prompting Large Language Models as Explainable Metrics Task
AACL 2023
Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval
EMNLP 2023
Re-Examining Summarization Evaluation across Multiple Quality Criteria
EMNLP 2023
Reference-Free Summarization Evaluation with Large Language Models
AACL 2023
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation
ACL 2023
RISE: Leveraging Retrieval Techniques for Summarization Evaluation
ACL 2023
SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation
EMNLP 2023
SMART: Sentences as Basic Units for Text Evaluation
ICLR 2023
SummEdits: Measuring LLM Ability at Factual Reasoning Through The Lens of Summarization
EMNLP 2023
The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics
AACL 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization
CoNLL 2023
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models
EMNLP 2023
UMSE: Unified Multi-scenario Summarization Evaluation
ACL 2023
Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors
ACL 2023
Understanding Large Language Model Based Metrics for Text Summarization
AACL 2023
Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics
ACL 2022
DialSummEval: Revisiting Summarization Evaluation for Dialogues
NAACL 2022
Does Summary Evaluation Survive Translation to Other Languages?
NAACL 2022
FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation
EMNLP 2022
InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation
AAAI 2022
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries
NAACL 2022
Investigating Metric Diversity for Evaluating Long Document Summarisation
COLING 2022
PrefScore: Pairwise Preference Learning for Reference-free Summarization Quality Assessment
COLING 2022
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization
NAACL 2022
Questioning the Validity of Summarization Datasets and Improving Their Factual Consistency
EMNLP 2022