conftrace_

human judgment

74 papers

Explore in graph

Co-occurring keywords

evaluation metric (573) large language model (13587) machine translation (2499) automatic evaluation (225) language model (4599) human evaluation (379) image captioning (731) text summarization (896) metric correlation (23) automatic metric (65)

Papers

Adjusting Interpretable Dimensions in Embedding Space with Human Judgments NAACL 2024
Is Reference Necessary in the Evaluation of NLG Systems? When and Where? NAACL 2024
AnthroScore: A Computational Linguistic Measure of Anthropomorphism EACL 2024
Human Temporal Inferences Go Beyond Aspectual Class EACL 2024
Evaluating Dynamic Topic Models ACL 2024
Evaluating Grammatical Well-Formedness in Large Language Models: A Comparative Study with Human Judgments ACL 2024
Contextualized Topic Coherence Metrics EACL 2024
Every Answer Matters: Evaluating Commonsense with Probabilistic Measures ACL 2024
C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation ACL 2023
Do dialogue representations align with perception? An empirical study EACL 2023
MISMATCH: Fine-grained Evaluation of Machine-generated Text with Mismatch Error Types ACL 2023
Trained MT Metrics Learn to Cope with Machine-translated References EMNLP 2023
Revisiting Automated Topic Model Evaluation with Large Language Models EMNLP 2023
CLAIR: Evaluating Image Captions with Large Language Models EMNLP 2023
Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE? ACL 2022
Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics NAACL 2022
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022
Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour AACL 2022
FineD-Eval: Fine-grained Automatic Dialogue-Level Evaluation EMNLP 2022
Pre-trained language models evaluating themselves - A comparative study ACL 2022
Play the Shannon Game with Language Models: A Human-Free Approach to Summary Evaluation AAAI 2022
Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning ACL 2022
A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ACL 2022
MS-COMET: More and Better Human Judgements Improve Metric Performance EMNLP 2022
Human-Model Divergence in the Handling of Vagueness IJCNLP 2021