human evaluation

InspectorRAGet: An Introspection Platform for RAG Evaluation NAACL 2025 Is my Meeting Summary Good? Estimating Quality with a Multi-LLM Evaluator COLING 2025 Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness NAACL 2025 Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025 Language Models Learn to Mislead Humans via RLHF ICLR 2025 Lessons from a User Experience Evaluation of NLP Interfaces NAACL 2025 LiteraryQA: Towards Effective Evaluation of Long-document Narrative QA EMNLP 2025 LiTransProQA: An LLM-based Literary Translation Evaluation Metric with Professional Question Answering EMNLP 2025 LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks ACL 2025 Lost in Literalism: How Supervised Training Shapes Translationese in LLMs ACL 2025 Patent-CR: A Dataset for Patent Claim Revision NAACL 2025 People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text ACL 2025 Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation ICLR 2025 ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering ACL 2025 Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content CVPR 2025 Quantifying the Influence of Evaluation Aspects on Long-Form Response Assessment COLING 2025 Ranking Over Scoring: Towards Reliable and Robust Automated Evaluation of LLM-Generated Medical Explanatory Arguments COLING 2025 Real-World Summarization: When Evaluation Reaches Its Limits EMNLP 2025 Refined Assessment for Translation Evaluation: Rethinking Machine Translation Evaluation in the Era of Human-Level Systems EMNLP 2025 REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities ACL 2025 ReproHum #0031-01: Reproducing the Human Evaluation of Readability from “It is AI’s Turn to Ask Humans a Question” ACL 2025 ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective ACL 2025 ReproHum #0067-01: A Reproduction of the Evaluation of Cross-Lingual Summarization ACL 2025 ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025 ReproHum #0729-04: Human Evaluation Reproduction Report for “MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes” ACL 2025