conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

We Need to Consider Disagreement in Evaluation ACL 2021
SumPubMed: Summarization Dataset of PubMed Scientific Articles ACL 2021
UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning ACL 2021
Perturbation CheckLists for Evaluating NLG Evaluation Metrics EMNLP 2021
Semantic Similarity Based Evaluation for Abstractive News Summarization ACL 2021
Simpson's Bias in NLP Training AAAI 2021
Evaluation of Thematic Coherence in Microblogs ACL 2021
Towards the evaluation of automatic simultaneous speech translation from a communicative perspective ACL 2021
On Sampled Metrics for Item Recommendation (Extended Abstract) IJCAI 2021
Semantic Answer Similarity for Evaluating Question Answering Models EMNLP 2021
MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluation EMNLP 2021
Negation-Instance Based Evaluation of End-to-End Negation Resolution EMNLP 2021
Implementing Evaluation Metrics Based on Theories of Democracy in News Comment Recommendation (Hackathon Report) EACL 2021
Language Model Augmented Relevance Score IJCNLP 2021
Fabula Entropy Indexing: Objective Measures of Story Coherence NAACL 2021
A Tutorial on Evaluation Metrics used in Natural Language Generation NAACL 2021
Difficulty-Aware Machine Translation Evaluation ACL 2021
Semantic Similarity Based Evaluation for Abstractive News Summarization IJCNLP 2021
Grounding Plural Phrases: Countering Evaluation Biases by Individuation NAACL 2021
Plot-guided Adversarial Example Construction for Evaluating Open-domain Story Generation NAACL 2021
KPQA: A Metric for Generative Question Answering Using Keyphrase Weights NAACL 2021
What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP EMNLP 2021
Towards Objectively Evaluating the Quality of Generated Medical Summaries EACL 2021
The statistical advantage of automatic NLG metrics at the system level ACL 2021
Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking EMNLP 2021