conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

EduQuick: A Dataset Toward Evaluating Summarization of Informal Educational Content for Social Media AACL 2023
Automating Human Evaluation of Dialogue Systems NAACL 2022
Opportunities for Human-centered Evaluation of Machine Translation Systems NAACL 2022
Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation ACL 2022
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation COLING 2022
Findings of the WMT’22 Shared Task on Large-Scale Machine Translation Evaluation for African Languages EMNLP 2022
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets EMNLP 2022
GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation EMNLP 2022
Simple and Effective Unsupervised Speech Synthesis INTERSPEECH 2022
Searching for a Higher Power in the Human Evaluation of MT EMNLP 2022
FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation EMNLP 2022
Human perceiving behavior modeling in evaluation of code generation models EMNLP 2022
The Fewer Splits are Better: Deconstructing Readability in Sentence Splitting EMNLP 2022
Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation EMNLP 2022
Creative Text-to-Image Generation: Suggestions for a Benchmark AACL 2022
Achieving Reliable Human Assessment of Open-Domain Dialogue Systems ACL 2022
Evaluation of Response Generation Models: Shouldn’t It Be Shareable and Replicable? EMNLP 2022
The Authenticity Gap in Human Evaluation EMNLP 2022
Findings of the 2022 Conference on Machine Translation (WMT22) EMNLP 2022
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions ACL 2022
Sarcasm Detection is Way Too Easy! An Empirical Comparison of Human and Machine Sarcasm Detection EMNLP 2022
Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems EMNLP 2022
Are Neural Topic Models Broken? EMNLP 2022
Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation EMNLP 2022
DialSummEval: Revisiting Summarization Evaluation for Dialogues NAACL 2022