conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs EMNLP 2023
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet EMNLP 2023
Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist EMNLP 2023
A Human Subject Study of Named Entity Recognition in Conversational Music Recommendation Queries EACL 2023
Towards MOOCs for Lipreading: Using Synthetic Talking Heads To Train Humans in Lipreading at Scale WACV 2023
Non-Repeatable Experiments and Non-Reproducible Results: The Reproducibility Crisis in Human Evaluation in NLP ACL 2023
A Survey of Evaluation Methods of Generated Medical Textual Reports ACL 2023
BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric ACL 2023
Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent EMNLP 2023
GPT-4 as an Effective Zero-Shot Evaluator for Scientific Figure Captions EMNLP 2023
Evaluating Verifiability in Generative Search Engines EMNLP 2023
Decoding Stumpers: Large Language Models vs. Human Problem-Solvers EMNLP 2023
Alexa Arena: A User-Centric Interactive Platform for Embodied AI NIPS 2023
Transformers Go for the LOLs: Generating (Humourous) Titles from Scientific Abstracts End-to-End AACL 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization CONLL 2023
JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models CONLL 2023
Opportunities and Challenges in Neural Dialog Tutoring EACL 2023
LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization EACL 2023
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP EACL 2023
Exploring Prompting Large Language Models as Explainable Metrics IJCNLP 2023
Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluation ICCV 2023
Towards Credible Human Evaluation of Open-Domain Dialog Systems Using Interactive Setup AAAI 2023
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation ACL 2023
Are Experts Needed? On Human Evaluation of Counselling Reflection Generation ACL 2023
RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue ACL 2023