human evaluation

Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy EMNLP 2024 Improving the TENOR of Labeling: Re-evaluating Topic Models for Content Analysis EACL 2024 I’m sure you’re a real scholar yourself: Exploring Ironic Content Generation by Large Language Models EMNLP 2024 Intrinsic Task-based Evaluation for Referring Expression Generation ACL 2024 Is Self-Repair a Silver Bullet for Code Generation? ICLR 2024 Is Summary Useful or Not? An Extrinsic Human Evaluation of Text Summaries on Downstream Tasks COLING 2024 Knowledge-Centric Templatic Views of Documents EMNLP 2024 Language Models Hallucinate, but May Excel at Fact Verification NAACL 2024 Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction NAACL 2024 Limitations of Human Identification of Automatically Generated Text COLING 2024 LLMEval: A Preliminary Study on How to Evaluate Large Language Models AAAI 2024 Measuring Psychological Depth in Language Models EMNLP 2024 Meta-Evaluation of Sentence Simplification Metrics COLING 2024 METAL: Towards Multilingual Meta-Evaluation NAACL 2024 MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024 Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies ACL 2024 Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References NAACL 2024 Not (yet) the whole story: Evaluating Visual Storytelling Requires More than Measuring Coherence, Grounding, and Repetition EMNLP 2024 Once Upon a Replication: It is Humans’ Turn to Evaluate AI’s Understanding of Children’s Stories for QA Generation COLING 2024 On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods AAAI 2024 Optimizing the role of human evaluation in LLM-based spoken document summarization systems Interspeech 2024 PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data EMNLP 2024 Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing? EMNLP 2024 ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models ACL 2024 QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation EMNLP 2024