Co-occurring keywords · papers mentioning both
Papers
Multi Document Summarization Evaluation in the Presence of Damaging Content
EMNLP 2023
Multifaceted Challenge Set for Evaluating Machine Translation Performance
EMNLP 2023
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist
ACL 2023
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation
ACL 2023
On the Evaluation of Neural Selective Prediction Methods for Natural Language Processing
ACL 2023
Ontology-aware Learning and Evaluation for Audio Tagging
Interspeech 2023
Precision Recall Cover: A Method For Assessing Generative Models
AISTATS 2023
PriMeSRL-Eval: A Practical Quality Metric for Semantic Role Labeling Systems Evaluation
EACL 2023
PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioning
EMNLP 2023
Pulling Out All The Full Stops: Punctuation Sensitivity in Neural Machine Translation and Evaluation
ACL 2023
Ranger: A Toolkit for Effect-Size Based Multi-Task Evaluation
ACL 2023
Re-Examining Summarization Evaluation across Multiple Quality Criteria
EMNLP 2023
Retrieval-based Evaluation for LLMs: A Case Study in Korean Legal QA
EMNLP 2023
Revisiting Evaluation Metrics for Semantic Segmentation: Optimization and Evaluation of Fine-grained Intersection over Union
NeurIPS 2023
Robust Detection Outcome: A Metric for Pathology Detection in Medical Images
MIDL 2023
Rogue Scores
ACL 2023
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question
ACL 2023
Simplicity Level Estimate (SLE): A Learned Reference-Less Metric for Sentence Simplification
EMNLP 2023
SMART: Sentences as Basic Units for Text Evaluation
ICLR 2023
SMATCH++: Standardized and Extended Evaluation of Semantic Graphs
EACL 2023
Summary Cycles: Exploring the Impact of Prompt Engineering on Large Language Models’ Interaction with Interaction Log Information
AACL 2023
SUT: Active Defects Probing for Transcompiler Models
EMNLP 2023
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics
EMNLP 2023
The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics
ACL 2023
Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration
EMNLP 2023