evaluation benchmark

Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Pot ICML 2021 What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP EMNLP 2021 WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context EACL 2021 A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers ACL 2020 An Analysis of Natural Language Inference Benchmarks through the Lens of Negation EMNLP 2020 Automatically Identifying Gender Issues in Machine Translation using Perturbations EMNLP 2020 COGS: A Compositional Generalization Challenge Based on Semantic Interpretation EMNLP 2020 Evaluating Models’ Local Decision Boundaries via Contrast Sets EMNLP 2020 GLUECoS: An Evaluation Benchmark for Code-Switched NLP ACL 2020 How coherent are neural models of coherence? COLING 2020 MLQA: Evaluating Cross-lingual Extractive Question Answering ACL 2020 MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics EMNLP 2020 R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason ACL 2020 Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations EMNLP 2020 What Question Answering can Learn from Trivia Nerds ACL 2020 Comprehensive Multi-Dataset Evaluation of Reading Comprehension EMNLP 2019 Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations EMNLP 2019 ReQA: An Evaluation for End-to-End Answer Retrieval Models EMNLP 2019 A Pronoun Test Suite Evaluation of the English–German MT Systems at WMT 2018 EMNLP 2018 A Parallel Corpus for Evaluating Machine Translation between Arabic and European Languages EACL 2017 Bringing Structure into Summaries: Crowdsourcing a Benchmark Corpus of Concept Maps EMNLP 2017 JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction EACL 2017 The limits of automatic summarisation according to ROUGE EACL 2017