human judgment

AnthroScore: A Computational Linguistic Measure of Anthropomorphism EACL 2024 Beyond Reference: Evaluating High Quality Translations Better than Human References EMNLP 2024 Contextualized Topic Coherence Metrics EACL 2024 Evaluating Dynamic Topic Models ACL 2024 Evaluating Grammatical Well-Formedness in Large Language Models: A Comparative Study with Human Judgments ACL 2024 Every Answer Matters: Evaluating Commonsense with Probabilistic Measures ACL 2024 Human Temporal Inferences Go Beyond Aspectual Class EACL 2024 Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024 Is Reference Necessary in the Evaluation of NLG Systems? When and Where? NAACL 2024 Open-Domain Text Evaluation via Contrastive Distribution Methods ICML 2024 Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models EMNLP 2024 Quality Diversity through Human Feedback: Towards Open-Ended Diversity-Driven Optimization ICML 2024 CLAIR: Evaluating Image Captions with Large Language Models EMNLP 2023 C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation ACL 2023 Do dialogue representations align with perception? An empirical study EACL 2023 MISMATCH: Fine-grained Evaluation of Machine-generated Text with Mismatch Error Types ACL 2023 Revisiting Automated Topic Model Evaluation with Large Language Models EMNLP 2023 Trained MT Metrics Learn to Cope with Machine-translated References EMNLP 2023 A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ACL 2022 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022 Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning ACL 2022 Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour AACL 2022 FineD-Eval: Fine-grained Automatic Dialogue-Level Evaluation EMNLP 2022 MS-COMET: More and Better Human Judgements Improve Metric Performance EMNLP 2022 Play the Shannon Game with Language Models: A Human-Free Approach to Summary Evaluation AAAI 2022