human evaluation

Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust EMNLP 2022 Rethinking Document-level Neural Machine Translation ACL 2022 Sarcasm Detection is Way Too Easy! An Empirical Comparison of Human and Machine Sarcasm Detection EMNLP 2022 Searching for a Higher Power in the Human Evaluation of MT EMNLP 2022 Simple and Effective Unsupervised Speech Synthesis Interspeech 2022 Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions ACL 2022 SQuALITY: Building a Long-Document Summarization Dataset the Hard Way EMNLP 2022 Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems EMNLP 2022 The Authenticity Gap in Human Evaluation EMNLP 2022 The Fewer Splits are Better: Deconstructing Readability in Sentence Splitting EMNLP 2022 The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ACL 2022 The patient is more dead than alive: exploring the current state of the multi-document summarisation of the biomedical literature ACL 2022 Toward More Effective Human Evaluation for Machine Translation ACL 2022 Transparent Human Evaluation for Image Captioning NAACL 2022 Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output CoNLL 2021 All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text ACL 2021 A Review of Human Evaluation for Style Transfer ACL 2021 Comparing Grammatical Theories of Code-Mixing EMNLP 2021 cushLEPOR: customising hLEPOR metric using Optuna for higher agreement with human judgments or pre-trained language model LaBSE EMNLP 2021 Detecting Post-Edited References and Their Effect on Human Evaluation EACL 2021 Estimating Subjective Crowd-Evaluations as an Additional Objective to Improve Natural Language Generation EACL 2021 Evaluating Multiway Multilingual NMT in the Turkic Languages EMNLP 2021 Evaluating the Evaluation of Diversity in Natural Language Generation EACL 2021 Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021 Finding a Balanced Degree of Automation for Summary Evaluation EMNLP 2021