Skip to content
conftrace_

human evaluation

383 papers

HE

Papers

CI-VID: A Coherent Interleaved Text-Video Dataset CVPR 2026 Confirmation Bias: A Challenge for Scalable Oversight AAAI 2026 Counterspeech Generation using Small Language Models ACL 2026 Do NOT Classify and Count: Hybrid Attribute Control Success Evaluation EACL 2026 Evaluating Native-Speaker Preferences on Machine Translation and Post-Edits for Five African Languages EACL 2026 Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation ACL 2026 L52+-IIMAS-UNAM at SemEval-2026 Task 1 (MWAHAHA): Joke Selection Through a Multi-Stage Prompt-Engineering and Heuristic Pipeline SemEval 2026 MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation ACL 2026 MTQE.en-he: Machine Translation Quality Estimation for English-Hebrew EACL 2026 Now They See It, Now They Don’t: Multimodal Reward Models Exhibit Unreliability in Physical World Constraints CoNLL 2026 Simple Agents, Biased Judges: Efficient Multi-Party Dialogue Generation & The Evaluation Gap ACL 2026 SLVMEval: Synthetic Meta Evaluation Benchmark for Text-to-Long Video Generation CVPR 2026 Synthetic Data Generation Pipeline for Low-Resource Swahili Sentiment Analysis: Multi-LLM Judging with Human Validation EACL 2026 TempViz: On the Evaluation of Temporal Knowledge in Text-to-Image Models EACL 2026 Understanding Generative AI Capabilities in Everyday Image Editing Tasks WACV 2026 Who Generates More Empathetic Responses—Humans or LLMs? A Comparative Evaluation with Human and LLM Judges CoNLL 2026 A Benchmark for Translations Across Styles and Language Variants EMNLP 2025 A Framework for Large-Scale Parallel Corpus Evaluation: Ensemble Quality Estimation Models Versus Human Assessment ACL 2025 A Measure of the System Dependence of Automated Metrics ACL 2025 Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation NAACL 2025 Are Checklists Really Useful for Automatic Evaluation of Generative Tasks? EMNLP 2025 Ask Me Like I’m Human: LLM-based Evaluation with For-Human Instructions Correlates Better with Human Evaluations than Human Judges ACL 2025 Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation ACL 2025 Benchmarking LLMs on Semantic Overlap Summarization EMNLP 2025 Beyond FVD: An Enhanced Evaluation Metrics for Video Generation Distribution Quality ICLR 2025