human evaluation

Beyond N-Grams: Rethinking Evaluation Metrics and Strategies for Multilingual Abstractive Summarization ACL 2025 Can AI Make Us Laugh? Comparing Jokes Generated by Witscript and a Human Expert COLING 2025 Can Large Language Models Unlock Novel Scientific Research Ideas? EMNLP 2025 Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers ICLR 2025 CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era ACL 2025 Challenges in Trustworthy Human Evaluation of Chatbots NAACL 2025 Context Is Ubiquitous, but Rarely Changes Judgments: Revisiting Document-Level MT Evaluation EMNLP 2025 CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics EMNLP 2025 DaKultur: Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers NAACL 2025 Direct Motion Models for Assessing Generated Videos ICML 2025 ELI-Why: Evaluating the Pedagogical Utility of Language Model Explanations ACL 2025 Enhancing Human Evaluation in Machine Translation with Comparative Judgement ACL 2025 Estimating LLM Consistency: A User Baseline vs Surrogate Metrics EMNLP 2025 Evaluating Large Language Models for Narrative Topic Labeling NAACL 2025 Evaluating the Evaluators: Are readability metrics good measures of readability? EMNLP 2025 Evaluation of LLM for English to Hindi Legal Domain Machine Translation Systems EMNLP 2025 EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correction AAAI 2025 Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks COLING 2025 Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets EMNLP 2025 GRADEO: Towards Human-Like Evaluation for Text-to-Video Generation via Multi-Step Reasoning ICML 2025 G-VEval: A Versatile Metric for Evaluating Image and Video Captions Using GPT-4o AAAI 2025 Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress ACL 2025 HEDS 3.0: The Human Evaluation Data Sheet Version 3.0 ACL 2025 How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs NAACL 2025 How Well Can Large Language Models Reflect? A Human Evaluation of LLM-generated Reflections for Motivational Interviewing Dialogues COLING 2025