conftrace_

human evaluation

379 papers

Explore in graph

Also known as

HE

Co-occurring keywords

large language model (13587) machine translation (2499) natural language generation (785) evaluation metric (573) text generation (2913) automatic evaluation (225) automatic metric (65) translation quality (224) language model (4599) dialogue system (1667)

Papers

Optimizing the role of human evaluation in LLM-based spoken document summarization systems INTERSPEECH 2024
ReproHum #0712-01: Human Evaluation Reproduction Report for “Hierarchical Sketch Induction for Paraphrase Generation” COLING 2024
ReproHum #0043-4: Evaluating Summarization Models: investigating the impact of education and language proficiency on reproducibility COLING 2024
On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods AAAI 2024
How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? EMNLP 2024
Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability, Reproducibility, and Practicality NIPS 2024
Findings of the WMT 2024 Shared Task on Chat Translation EMNLP 2024
ReproHum #0033-3: Comparable Relative Results with Lower Absolute Values in a Reproduction Study COLING 2024
Measuring Psychological Depth in Language Models EMNLP 2024
Once Upon a Replication: It is Humans’ Turn to Evaluate AI’s Understanding of Children’s Stories for QA Generation COLING 2024
ReproHum #0087-01: A Reproduction Study of the Human Evaluation of the Coverage of Fact Checking Explanations COLING 2024
Is Summary Useful or Not? An Extrinsic Human Evaluation of Text Summaries on Downstream Tasks COLING 2024
Opportunities and Challenges in Neural Dialog Tutoring EACL 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization CONLL 2023
JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models CONLL 2023
Overlooked Factors in Concept-Based Explanations: Dataset Choice, Concept Learnability, and Human Capability CVPR 2023
Transformers Go for the LOLs: Generating (Humourous) Titles from Scientific Abstracts End-to-End AACL 2023
Alexa Arena: A User-Centric Interactive Platform for Embodied AI NIPS 2023
Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation CVPR 2023
VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models NIPS 2023
Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist EMNLP 2023
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet EMNLP 2023
Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023
Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs EMNLP 2023
Decoding Stumpers: Large Language Models vs. Human Problem-Solvers EMNLP 2023