conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Toward More Effective Human Evaluation for Machine Translation ACL 2022
SQuALITY: Building a Long-Document Summarization Dataset the Hard Way EMNLP 2022
Ditch the Gold Standard: Re-evaluating Conversational Question Answering ACL 2022
Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ACL 2022
Rethinking Document-level Neural Machine Translation ACL 2022
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks ACL 2022
On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation NAACL 2022
Overview of the First Shared Task on Multi Perspective Scientific Document Summarization (MuP) COLING 2022
Explain, Edit, and Understand: Rethinking User Study Design for Evaluating Model Explanations AAAI 2022
Does Summary Evaluation Survive Translation to Other Languages? NAACL 2022
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries NAACL 2022
Transparent Human Evaluation for Image Captioning NAACL 2022
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022
Overview of the 9th Workshop on Asian Translation COLING 2022
How Far are We from Robust Long Abstractive Summarization? EMNLP 2022
The patient is more dead than alive: exploring the current state of the multi-document summarisation of the biomedical literature ACL 2022
Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents ACL 2022
Human evaluation of web-crawled parallel corpora for machine translation ACL 2022
Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity NAACL 2022
A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ACL 2022
Learning to Rank Visual Stories From Human Ranking Data ACL 2022
The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ACL 2022
Findings of the Word-Level AutoCompletion Shared Task in WMT 2022 EMNLP 2022
A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ACL 2022
Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust EMNLP 2022