human evaluation

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet EMNLP 2023 Findings of the AmericasNLP 2023 Shared Task on Machine Translation into Indigenous Languages ACL 2023 GPT-4 as an Effective Zero-Shot Evaluator for Scientific Figure Captions EMNLP 2023 How do humans perceive adversarial text? A reality check on the validity and naturalness of word-based adversarial attacks ACL 2023 Human Raters Cannot Distinguish English Translations from Original English Texts EMNLP 2023 IC3: Image Captioning by Committee Consensus EMNLP 2023 Investigating Range-Equalizing Bias in Mean Opinion Score Ratings of Synthesized Speech Interspeech 2023 JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models CoNLL 2023 Large Language Models are biased to overestimate profoundness EMNLP 2023 Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization EMNLP 2023 Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist EMNLP 2023 LENS: A Learnable Evaluation Metric for Text Simplification ACL 2023 LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization EACL 2023 MISMATCH: Fine-grained Evaluation of Machine-generated Text with Mismatch Error Types ACL 2023 Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP EACL 2023 Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023 MT Metrics Correlate with Human Ratings of Simultaneous Speech Translation ACL 2023 Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation EMNLP 2023 Non-Repeatable Experiments and Non-Reproducible Results: The Reproducibility Crisis in Human Evaluation in NLP ACL 2023 Opportunities and Challenges in Neural Dialog Tutoring EACL 2023 Overlooked Factors in Concept-Based Explanations: Dataset Choice, Concept Learnability, and Human Capability CVPR 2023 Pardon my disfluency: The impact of disfluency effects on the perception of speaker competence and confidence Interspeech 2023 Prompterator: Iterate Efficiently towards More Effective Prompts EMNLP 2023 RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue ACL 2023 Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023