conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correction AAAI 2025
ReproHum #0729-04: Partial reproduction of the human evaluation of the MemSum and NeuSum summarisation systems ACL 2025
Ask Me Like I’m Human: LLM-based Evaluation with For-Human Instructions Correlates Better with Human Evaluations than Human Judges ACL 2025
Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress ACL 2025
Evaluating Large Language Models for Narrative Topic Labeling NAACL 2025
Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025
ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering ACL 2025
Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks COLING 2025
How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs NAACL 2025
Context Is Ubiquitous, but Rarely Changes Judgments: Revisiting Document-Level MT Evaluation EMNLP 2025
Evaluating the Evaluators: Are readability metrics good measures of readability? EMNLP 2025
Estimating LLM Consistency: A User Baseline vs Surrogate Metrics EMNLP 2025
Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content CVPR 2025
Lost in Literalism: How Supervised Training Shapes Translationese in LLMs ACL 2025
Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist EMNLP 2025
Benchmarking LLMs on Semantic Overlap Summarization EMNLP 2025
Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets EMNLP 2025
Evaluation of LLM for English to Hindi Legal Domain Machine Translation Systems EMNLP 2025
Structured Human Assessment of Text-to-Image Generative Models WACV 2025
DaKultur: Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers NAACL 2025
A Framework for Large-Scale Parallel Corpus Evaluation: Ensemble Quality Estimation Models Versus Human Assessment ACL 2025
Can AI Make Us Laugh? Comparing Jokes Generated by Witscript and a Human Expert COLING 2025
ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective ACL 2025
LiTransProQA: An LLM-based Literary Translation Evaluation Metric with Professional Question Answering EMNLP 2025
Is my Meeting Summary Good? Estimating Quality with a Multi-LLM Evaluator COLING 2025