human evaluation

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent EMNLP 2023 Rethinking the Word-level Quality Estimation for Machine Translation from Human Judgement ACL 2023 Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation ACL 2023 SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation EMNLP 2023 The Iron(ic) Melting Pot: Reviewing Human Evaluation in Humour, Irony and Sarcasm Generation EMNLP 2023 The Role of ImageNet Classes in Fréchet Inception Distance ICLR 2023 Toward Human-Like Evaluation for Natural Language Generation with Error Analysis ACL 2023 Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization CoNLL 2023 Towards Credible Human Evaluation of Open-Domain Dialog Systems Using Interactive Setup AAAI 2023 Towards MOOCs for Lipreading: Using Synthetic Talking Heads To Train Humans in Lipreading at Scale WACV 2023 Towards Symbiotic Creativity: A Methodological Approach to Compare Human and AI Robotic Dance Creations IJCAI 2023 Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation CVPR 2023 Transformers Go for the LOLs: Generating (Humourous) Titles from Scientific Abstracts End-to-End AACL 2023 TwistList: Resources and Baselines for Tongue Twister Generation ACL 2023 VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models NeurIPS 2023 Achieving Reliable Human Assessment of Open-Domain Dialogue Systems ACL 2022 A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ACL 2022 Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity NAACL 2022 Are Neural Topic Models Broken? EMNLP 2022 A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ACL 2022 Automating Human Evaluation of Dialogue Systems NAACL 2022 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022 Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation EMNLP 2022 Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation EMNLP 2022 Creative Text-to-Image Generation: Suggestions for a Benchmark AACL 2022