conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Quantifying the Influence of Evaluation Aspects on Long-Form Response Assessment COLING 2025
Specification-Aware Machine Translation and Evaluation for Purpose Alignment EMNLP 2025
How Well Can Large Language Models Reflect? A Human Evaluation of LLM-generated Reflections for Motivational Interviewing Dialogues COLING 2025
How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs NAACL 2025
QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation EMNLP 2024
Reconsidering Sentence-Level Sign Language Translation EMNLP 2024
ReproHum#0043: Human Evaluation Reproducing Language Model as an Annotator: Exploring Dialogue Summarization on AMI Dataset COLING 2024
To What Extent Are Large Language Models Capable of Generating Substantial Reflections for Motivational Interviewing Counseling Chatbots? A Human Evaluation ACL 2024
ReproHum #0927-3: Reproducing The Human Evaluation Of The DExperts Controlled Text Generation Method COLING 2024
ReproHum #0712-01: Human Evaluation Reproduction Report for “Hierarchical Sketch Induction for Paraphrase Generation” COLING 2024
The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement INTERSPEECH 2024
Optimizing the role of human evaluation in LLM-based spoken document summarization systems INTERSPEECH 2024
On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods AAAI 2024
ReproHum: #0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August et al. 2022 COLING 2024
ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models ACL 2024
BotEval: Facilitating Interactive Human Evaluation ACL 2024
Findings of the First Workshop on Simulating Conversational Intelligence in Chat EACL 2024
ReproHum #0043-4: Evaluating Summarization Models: investigating the impact of education and language proficiency on reproducibility COLING 2024
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies ACL 2024
Speech vs. Transcript: Does It Matter for Human Annotators in Speech Summarization? ACL 2024
ReproHum #0927-03: DExpert Evaluation? Reproducing Human Judgements of the Fluency of Generated Text COLING 2024
Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction NAACL 2024
Human-Centered Design Recommendations for LLM-as-a-judge ACL 2024
MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024
Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation COLING 2024