human evaluation

What Have We Achieved on Non-autoregressive Translation? ACL 2024 What’s under the hood: Investigating Automatic Metrics on Meeting Summarization EMNLP 2024 A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing EMNLP 2023 A Critical Evaluation of Evaluations for Long-form Question Answering ACL 2023 A Human Subject Study of Named Entity Recognition in Conversational Music Recommendation Queries EACL 2023 Alexa Arena: A User-Centric Interactive Platform for Embodied AI NeurIPS 2023 Aligning Offline Metrics and Human Judgments of Value for Code Generation Models ACL 2023 Are Experts Needed? On Human Evaluation of Counselling Reflection Generation ACL 2023 Are Language Models Worse than Humans at Following Prompts? It’s Complicated EMNLP 2023 Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs EMNLP 2023 A Survey of Evaluation Methods of Generated Medical Textual Reports ACL 2023 Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations ACL 2023 Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluation ICCV 2023 BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric ACL 2023 Can Large Language Models Be an Alternative to Human Evaluations? ACL 2023 Correction of Errors in Preference Ratings from Automated Metrics for Text Generation ACL 2023 Data Sampling and (In)stability in Machine Translation Evaluation ACL 2023 Decoding Stumpers: Large Language Models vs. Human Problem-Solvers EMNLP 2023 Don’t Forget Your ABC’s: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems ACL 2023 EduQuick: A Dataset Toward Evaluating Summarization of Informal Educational Content for Social Media AACL 2023 EntSUMv2: Dataset, Models and Evaluation for More Abstractive Entity-Centric Summarization EMNLP 2023 Evaluating Open-Domain Question Answering in the Era of Large Language Models ACL 2023 Evaluating Verifiability in Generative Search Engines EMNLP 2023 Exploring the Potential of Large Language Models in Generating Code-Tracing Questions for Introductory Programming Courses EMNLP 2023 FFAEval: Evaluating Dialogue System via Free-For-All Ranking EMNLP 2023