conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

How Robust are Model Rankings : A Leaderboard Customization Approach for Equitable Evaluation AAAI 2021
On Estimating Recommendation Evaluation Metrics under Sampling AAAI 2021
A Method for Taxonomy-Aware Embeddings Evaluation (Student Abstract) AAAI 2021
Language Model Augmented Relevance Score ACL 2021
Flesch-Kincaid is Not a Text Simplification Evaluation Metric ACL 2021
How Might We Create Better Benchmarks for Speech Recognition? ACL 2021
Evaluation Scheme of Focal Translation for Japanese Partially Amended Statutes ACL 2021
CIDEr-R: Robust Consensus-based Image Description Evaluation EMNLP 2021
SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluation EMNLP 2021
Evaluating Natural Language Generation via Unbalanced Optimal Transport IJCAI 2020
FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization ACL 2020
SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics EMNLP 2020
Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics ACL 2020
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation ACL 2020
Facet-Aware Evaluation for Extractive Summarization ACL 2020
Reliable Fidelity and Diversity Metrics for Generative Models ICML 2020
An Effectiveness Metric for Ordinal Classification: Formal Properties and Experimental Results ACL 2020
Using PRMSE to evaluate automated scoring systems in the presence of label noise ACL 2020
Measuring What Counts: The Case of Rumour Stance Classification AACL 2020
Mark-Evaluate: Assessing Language Generation using Population Estimation Methods COLING 2020
UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation EMNLP 2020
Popularity Agnostic Evaluation of Knowledge Graph Embeddings UAI 2020
MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics EMNLP 2020
Dscorer: A Fast Evaluation Metric for Discourse Representation Structure Parsing ACL 2020
Speaker Sensitive Response Evaluation Model ACL 2020