human evaluation

Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach EMNLP 2021 Towards Code-Mixed Hinglish Dialogue Generation EMNLP 2021 Towards Document-Level Human MT Evaluation: On the Issues of Annotator Agreement, Effort and Misevaluation EACL 2021 Towards the evaluation of automatic simultaneous speech translation from a communicative perspective ACL 2021 Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics NAACL 2021 What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think EMNLP 2021 WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation ACL 2021 A Human Evaluation of AMR-to-English Generation Systems COLING 2020 Assessing Human-Parity in Machine Translation on the Segment Level EMNLP 2020 Best Practices for Crowd-based Evaluation of German Summarization: Comparing Crowd, Expert and Automatic Evaluation EMNLP 2020 DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection CVPR 2020 Evaluating Automatically Generated Phoneme Captions for Images Interspeech 2020 Evaluating Dialogue Generation Systems via Response Selection ACL 2020 Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior? ACL 2020 Item Response Theory for Efficient Human Evaluation of Chatbots EMNLP 2020 On The Evaluation of Machine Translation Systems Trained With Back-Translation ACL 2020 On the Same Page? Comparing Inter-Annotator Agreement in Sentence and Document Level Human Machine Translation Evaluation EMNLP 2020 Overview of the 7th Workshop on Asian Translation AACL 2020 Re-evaluating Evaluation in Text Summarization EMNLP 2020 Results of the WMT20 Metrics Shared Task EMNLP 2020 RoFT: A Tool for Evaluating Human Detection of Machine-Generated Text EMNLP 2020 Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics ACL 2020 Translationese as a Language in “Multilingual” NMT ACL 2020 Translation of New Named Entities from English to Chinese AACL 2020 Unbabel’s Participation in the WMT20 Metrics Shared Task EMNLP 2020