human evaluation

DialSummEval: Revisiting Summarization Evaluation for Dialogues NAACL 2022 Ditch the Gold Standard: Re-evaluating Conversational Question Answering ACL 2022 Does Summary Evaluation Survive Translation to Other Languages? NAACL 2022 Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks ACL 2022 Evaluation of Response Generation Models: Shouldn’t It Be Shareable and Replicable? EMNLP 2022 Explain, Edit, and Understand: Rethinking User Study Design for Evaluating Model Explanations AAAI 2022 FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation EMNLP 2022 Findings of the 2022 Conference on Machine Translation (WMT22) EMNLP 2022 Findings of the WMT’22 Shared Task on Large-Scale Machine Translation Evaluation for African Languages EMNLP 2022 Findings of the Word-Level AutoCompletion Shared Task in WMT 2022 EMNLP 2022 GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation EMNLP 2022 How Far are We from Robust Long Abstractive Summarization? EMNLP 2022 Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation ACL 2022 Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents ACL 2022 Human evaluation of web-crawled parallel corpora for machine translation ACL 2022 Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ACL 2022 Human perceiving behavior modeling in evaluation of code generation models EMNLP 2022 Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries NAACL 2022 Learning to Rank Visual Stories From Human Ranking Data ACL 2022 Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets EMNLP 2022 Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation COLING 2022 On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation NAACL 2022 Opportunities for Human-centered Evaluation of Machine Translation Systems NAACL 2022 Overview of the 9th Workshop on Asian Translation COLING 2022 Overview of the First Shared Task on Multi Perspective Scientific Document Summarization (MuP) COLING 2022