conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Estimating LLM Consistency: A User Baseline vs Surrogate Metrics EMNLP 2025
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation ACL 2025
Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets EMNLP 2025
Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition ACL 2025
Challenges in Trustworthy Human Evaluation of Chatbots NAACL 2025
LiteraryQA: Towards Effective Evaluation of Long-document Narrative QA EMNLP 2025
Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks COLING 2025
LiTransProQA: An LLM-based Literary Translation Evaluation Metric with Professional Question Answering EMNLP 2025
ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective ACL 2025
A Framework for Large-Scale Parallel Corpus Evaluation: Ensemble Quality Estimation Models Versus Human Assessment ACL 2025
Can AI Make Us Laugh? Comparing Jokes Generated by Witscript and a Human Expert COLING 2025
ReproHum #0744-02: A Reproduction of the Human Evaluation of Meaning Preservation in “Factorising Meaning and Form for Intent-Preserving Paraphrasing” ACL 2025
Context Is Ubiquitous, but Rarely Changes Judgments: Revisiting Document-Level MT Evaluation EMNLP 2025
ReproHum #0031-01: Reproducing the Human Evaluation of Readability from “It is AI’s Turn to Ask Humans a Question” ACL 2025
Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness NAACL 2025
Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content CVPR 2025
HEDS 3.0: The Human Evaluation Data Sheet Version 3.0 ACL 2025
ReproHum #0067-01: A Reproduction of the Evaluation of Cross-Lingual Summarization ACL 2025
Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist EMNLP 2025
ReproHum #0729-04: Partial reproduction of the human evaluation of the MemSum and NeuSum summarisation systems ACL 2025
REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities ACL 2025
Evaluating the Evaluators: Are readability metrics good measures of readability? EMNLP 2025
Benchmarking LLMs on Semantic Overlap Summarization EMNLP 2025
Lessons from a User Experience Evaluation of NLP Interfaces NAACL 2025
Can Large Language Models Unlock Novel Scientific Research Ideas? EMNLP 2025