human evaluation

ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models ACL 2024 Debating with More Persuasive LLMs Leads to More Truthful Answers ICML 2024 Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation NAACL 2024 DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Models NAACL 2024 Error Analysis of Multilingual Language Models in Machine Translation: A Case Study of English-Amharic Translation EMNLP 2024 Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation EMNLP 2024 Evaluating Large Language Models at Evaluating Instruction Following ICLR 2024 Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation COLING 2024 Evaluation of Really Good Grammatical Error Correction COLING 2024 Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation COLING 2024 Finding Replicable Human Evaluations via Stable Ranking Probability NAACL 2024 Findings of the AmericasNLP 2024 Shared Task on Machine Translation into Indigenous Languages NAACL 2024 Findings of the First Workshop on Simulating Conversational Intelligence in Chat EACL 2024 Findings of the WMT 2024 Shared Task on Chat Translation EMNLP 2024 Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translation EMNLP 2024 Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet EMNLP 2024 Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation EMNLP 2024 FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models EMNLP 2024 From General LLM to Translation: How We Dramatically Improve Translation Quality Using Human Evaluation Data for LLM Finetuning EMNLP 2024 GenAI Arena: An Open Evaluation Platform for Generative Models NeurIPS 2024 How Does Quantization Affect Multilingual LLMs? EMNLP 2024 How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? EMNLP 2024 Human-Centered Design Recommendations for LLM-as-a-judge ACL 2024 Humans or LLMs as the Judge? A Study on Judgement Bias EMNLP 2024 ImagenHub: Standardizing the evaluation of conditional image generation models ICLR 2024