conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

cushLEPOR: customising hLEPOR metric using Optuna for higher agreement with human judgments or pre-trained language model LaBSE EMNLP 2021
SumPubMed: Summarization Dataset of PubMed Scientific Articles ACL 2021
Human-like informative conversations: Better acknowledgements using conditional mutual information NAACL 2021
Human Perception in Natural Language Generation ACL 2021
It’s Commonsense, isn’t it? Demystifying Human Evaluations in Commonsense-Enhanced NLG Systems EACL 2021
Topic Model or Topic Twaddle? Re-evaluating Semantic Interpretability Measures NAACL 2021
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation EMNLP 2021
Estimating Subjective Crowd-Evaluations as an Additional Objective to Improve Natural Language Generation EACL 2021
Towards Document-Level Human MT Evaluation: On the Issues of Annotator Agreement, Effort and Misevaluation EACL 2021
The Great Misalignment Problem in Human Evaluation of NLP Methods EACL 2021
On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs EACL 2021
Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers IJCNLP 2021
WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation IJCNLP 2021
What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think EMNLP 2021
Comparing Grammatical Theories of Code-Mixing EMNLP 2021
Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort IJCNLP 2021
LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing IJCNLP 2021
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics IJCNLP 2021
Style-Aware Normalized Loss for Improving Arbitrary Style Transfer CVPR 2021
Lost in Interpreting: Speech Translation from Source or Interpreter? INTERSPEECH 2021
Is Automated Topic Model Evaluation Broken? The Incoherence of Coherence NIPS 2021
Reliability of Human Evaluation for Text Summarization: Lessons Learned and Challenges Ahead EACL 2021
A Review of Human Evaluation for Style Transfer ACL 2021
Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers ACL 2021
Overview of the 8th Workshop on Asian Translation ACL 2021