benchmark evaluation

DiaLex: A Benchmark for Evaluating Multidialectal Arabic Word Embeddings EACL 2021 Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking NeurIPS 2021 E-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks ICCV 2021 Human-Adversarial Visual Question Answering NeurIPS 2021 Identifying and Benchmarking Natural Out-of-Context Prediction Problems NeurIPS 2021 If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques IJCAI 2021 Is “moby dick” a Whale or a Bird? Named Entities and Terminology in Speech Translation EMNLP 2021 Just How Toxic is Data Poisoning? A Unified Benchmark for Backdoor and Data Poisoning Attacks ICML 2021 LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech Interspeech 2021 Methods for the Design and Evaluation of HCI+NLP Systems EACL 2021 Numerical reasoning in machine reading comprehension tasks: are we there yet? EMNLP 2021 On the Limits of Pseudo Ground Truth in Visual Camera Re-Localisation ICCV 2021 Open Images V5 Text Annotation and Yet Another Mask Text Spotter ACML 2021 Parameter Selection: Why We Should Pay More Attention to It ACL 2021 Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding Interspeech 2021 Rethinking Evaluation in ASR: Are Our Models Robust Enough? Interspeech 2021 Revisiting Rainbow: Promoting more insightful and inclusive deep reinforcement learning research ICML 2021 RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms EMNLP 2021 Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning EMNLP 2021 The Corpora They Are a-Changing: a Case Study in Italian Newspapers ACL 2021 Towards Benchmarking the Utility of Explanations for Model Debugging NAACL 2021 Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction ACL 2021 Two Sides of Meta-Learning Evaluation: In vs. Out of Distribution NeurIPS 2021 We Need To Talk About Random Splits EACL 2021 We Need to Talk About train-dev-test Splits EMNLP 2021