conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

MTQE.en-he: Machine Translation Quality Estimation for English-Hebrew EACL 2026
TempViz: On the Evaluation of Temporal Knowledge in Text-to-Image Models EACL 2026
Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation ACL 2026
MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation ACL 2026
Synthetic Data Generation Pipeline for Low-Resource Swahili Sentiment Analysis: Multi-LLM Judging with Human Validation EACL 2026
Understanding Generative AI Capabilities in Everyday Image Editing Tasks WACV 2026
Do NOT Classify and Count: Hybrid Attribute Control Success Evaluation EACL 2026
Confirmation Bias: A Challenge for Scalable Oversight AAAI 2026
Counterspeech Generation using Small Language Models ACL 2026
Simple Agents, Biased Judges: Efficient Multi-Party Dialogue Generation & The Evaluation Gap ACL 2026
Evaluating Native-Speaker Preferences on Machine Translation and Post-Edits for Five African Languages EACL 2026
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation ACL 2025
Evaluation of LLM for English to Hindi Legal Domain Machine Translation Systems EMNLP 2025
Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition ACL 2025
Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets EMNLP 2025
Structured Human Assessment of Text-to-Image Generative Models WACV 2025
How Well Can Large Language Models Reflect? A Human Evaluation of LLM-generated Reflections for Motivational Interviewing Dialogues COLING 2025
Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist EMNLP 2025
Challenges in Trustworthy Human Evaluation of Chatbots NAACL 2025
ReproHum #0031-01: Reproducing the Human Evaluation of Readability from “It is AI’s Turn to Ask Humans a Question” ACL 2025
ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective ACL 2025
DaKultur: Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers NAACL 2025
Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025
Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness NAACL 2025
Benchmarking LLMs on Semantic Overlap Summarization EMNLP 2025