conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP EACL 2023
Hiding in Plain Sight: Insights into Abstractive Text Summarization EACL 2023
Ranger: A Toolkit for Effect-Size Based Multi-Task Evaluation ACL 2023
An Investigation of Evaluation Methods in Automatic Medical Note Generation ACL 2023
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics EMNLP 2023
Delving into Evaluation Metrics for Generation: A Thorough Assessment of How Metrics Generalize to Rephrasing Across Languages AACL 2023
Dragonfly_captain at SemEval-2023 Task 11: Unpacking Disagreement with Investigation of Annotator Demographics and Task Difficulty SEMEVAL 2023
Benchmarking eXplainable AI - A Survey on Available Toolkits and Open Challenges IJCAI 2023
HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models ICCV 2023
The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics ACL 2023
A Critical Evaluation of Evaluations for Long-form Question Answering ACL 2023
Toward More Accurate and Generalizable Evaluation Metrics for Task-Oriented Dialogs ACL 2023
Evaluating Factuality in Cross-lingual Summarization ACL 2023
MT Metrics Correlate with Human Ratings of Simultaneous Speech Translation ACL 2023
A Unified View of Evaluation Metrics for Structured Prediction EMNLP 2023
Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration EMNLP 2023
Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpus EMNLP 2023
Evaluation Metrics for Depth and Flow of Knowledge in Non-fiction Narrative Texts ACL 2023
On the Evaluation of Neural Selective Prediction Methods for Natural Language Processing ACL 2023
SUT: Active Defects Probing for Transcompiler Models EMNLP 2023
Optimal Correction Cost for Object Detection Evaluation CVPR 2022
Probing the Robustness of Trained Metrics for Conversational Dialogue Systems ACL 2022
TRUE: Re-evaluating Factual Consistency Evaluation ACL 2022
DialSummEval: Revisiting Summarization Evaluation for Dialogues NAACL 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance EMNLP 2022