conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Quality Estimation for Image Captions Based on Large-scale Human Evaluations NAACL 2021
All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text ACL 2021
All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text IJCNLP 2021
Perturbation CheckLists for Evaluating NLG Evaluation Metrics EMNLP 2021
Finding a Balanced Degree of Automation for Summary Evaluation EMNLP 2021
Neural Machine Translation Quality and Post-Editing Performance EMNLP 2021
Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German EMNLP 2021
Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output CONLL 2021
WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation ACL 2021
Towards the evaluation of automatic simultaneous speech translation from a communicative perspective ACL 2021
A Review of Human Evaluation for Style Transfer IJCNLP 2021
EmailSum: Abstractive Email Thread Summarization IJCNLP 2021
Human-Adversarial Visual Question Answering NIPS 2021
Detecting Post-Edited References and Their Effect on Human Evaluation EACL 2021
Evaluating the Evaluation of Diversity in Natural Language Generation EACL 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics NAACL 2021
Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain EMNLP 2021
Evaluating Multiway Multilingual NMT in the Turkic Languages EMNLP 2021
Towards Code-Mixed Hinglish Dialogue Generation EMNLP 2021
Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021
Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output EMNLP 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ACL 2021
Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach EMNLP 2021
Reference-Centric Models for Grounded Collaborative Dialogue EMNLP 2021
LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing ACL 2021