conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Dear Sir or Madam, May I Introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer NAACL 2018
The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results ACL 2018
A Call for Clarity in Reporting BLEU Scores EMNLP 2018
Reference-based Metrics can be Replaced with Reference-less Metrics in Evaluating Grammatical Error Correction Systems IJCNLP 2017
Optimizing Differentiable Relaxations of Coreference Evaluation Metrics CONLL 2017
Improving ROUGE for Timeline Summarization EACL 2017
Alternative Objective Functions for Training MT Evaluation Metrics ACL 2017
Evaluating Automatic Topic Segmentation as a Segment Retrieval Task INTERSPEECH 2017
Recall is the Proper Evaluation Metric for Word Segmentation IJCNLP 2017
Improving Evaluation of Document-level Machine Translation Quality Estimation EACL 2017
pyannote.metrics: A Toolkit for Reproducible Evaluation, Diagnostic, and Error Analysis of Speaker Diarization Systems INTERSPEECH 2017
Why We Need New Evaluation Metrics for NLG EMNLP 2017
The limits of automatic summarisation according to ROUGE EACL 2017
Annotating Derivations: A New Evaluation Strategy and Dataset for Algebra Word Problems EACL 2017
Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation EACL 2017
Evaluation Metrics for Machine Reading Comprehension: Prerequisite Skills and Readability ACL 2017
CIDEr: Consensus-Based Image Description Evaluation CVPR 2015
Ranking via Robust Binary Classification NIPS 2014
Measures and Meta-Measures for the Supervised Evaluation of Image Segmentation CVPR 2013
A Unified Video Segmentation Benchmark: Annotation, Metrics and Analysis ICCV 2013
On the (Non-)existence of Convex, Calibrated Surrogate Losses for Ranking NIPS 2012
PREA: Personalized Recommendation Algorithms Toolkit JMLR 2012
A Survey of Accuracy Evaluation Metrics of Recommendation Tasks JMLR 2009