conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Don’t Forget Your ABC’s: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems ACL 2023
Can Large Language Models Be an Alternative to Human Evaluations? ACL 2023
LENS: A Learnable Evaluation Metric for Text Simplification ACL 2023
A Critical Evaluation of Evaluations for Long-form Question Answering ACL 2023
Evaluating Open-Domain Question Answering in the Era of Large Language Models ACL 2023
Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations ACL 2023
Data Sampling and (In)stability in Machine Translation Evaluation ACL 2023
Rethinking the Word-level Quality Estimation for Machine Translation from Human Judgement ACL 2023
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models ACL 2023
EntSUMv2: Dataset, Models and Evaluation for More Abstractive Entity-Centric Summarization EMNLP 2023
Large Language Models are biased to overestimate profoundness EMNLP 2023
Human Raters Cannot Distinguish English Translations from Original English Texts EMNLP 2023
Prompterator: Iterate Efficiently towards More Effective Prompts EMNLP 2023
Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation EMNLP 2023
IC3: Image Captioning by Committee Consensus EMNLP 2023
Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation CVPR 2023
Overlooked Factors in Concept-Based Explanations: Dataset Choice, Concept Learnability, and Human Capability CVPR 2023
VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models NIPS 2023
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis ACL 2023
TwistList: Resources and Baselines for Tongue Twister Generation ACL 2023
SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation EMNLP 2023
Are Language Models Worse than Humans at Following Prompts? It’s Complicated EMNLP 2023
Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023
Towards Symbiotic Creativity: A Methodological Approach to Compare Human and AI Robotic Dance Creations IJCAI 2023
Investigating Range-Equalizing Bias in Mean Opinion Score Ratings of Synthesized Speech INTERSPEECH 2023