human evaluation

ReproHum #0729-04: Partial reproduction of the human evaluation of the MemSum and NeuSum summarisation systems ACL 2025 ReproHum #0744-02: A Reproduction of the Human Evaluation of Meaning Preservation in “Factorising Meaning and Form for Intent-Preserving Paraphrasing” ACL 2025 ReproHum: #0744-02: Investigating the Reproducibility of Semantic Preservation Human Evaluations ACL 2025 Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human? ACL 2025 Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition ACL 2025 SHEET: A Multi-purpose Open-source Speech Human Evaluation Estimation Toolkit Interspeech 2025 Small Language Models can Outperform Humans in Short Creative Writing: A Study Comparing SLMs with Humans and LLMs COLING 2025 Specification-Aware Machine Translation and Evaluation for Purpose Alignment EMNLP 2025 Structured Human Assessment of Text-to-Image Generative Models WACV 2025 Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist EMNLP 2025 The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs EMNLP 2025 Time Is Effort: Estimating Human Post-Editing Time for Grammar Error Correction Tool Evaluation EMNLP 2025 Towards Better Evaluation for Generated Patent Claims ACL 2025 Using LLM Judgements for Sanity Checking Results and Reproducibility of Human Evaluations in NLP ACL 2025 WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects ACL 2025 A Collection of Pragmatic-Similarity Judgments over Spoken Dialog Utterances COLING 2024 Adding Argumentation into Human Evaluation of Long Document Abstractive Summarization: A Case Study on Legal Opinions COLING 2024 AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages NAACL 2024 Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans NeurIPS 2024 Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output NAACL 2024 Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling AAAI 2024 BotEval: Facilitating Interactive Human Evaluation ACL 2024 Calibrating LLM-Based Evaluator COLING 2024 Clearer Governmental Communication: Text Simplification with ChatGPT Evaluated by Quantitative and Qualitative Research COLING 2024 Commentator: A Code-mixed Multilingual Text Annotation Framework EMNLP 2024