benchmark evaluation

What Will it Take to Fix Benchmarking in Natural Language Understanding? NAACL 2021 Adversarial Filters of Dataset Biases ICML 2020 Adversarial NLI: A New Benchmark for Natural Language Understanding ACL 2020 A Fair Comparison of Graph Neural Networks for Graph Classification ICLR 2020 Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets AAAI 2020 Benchmarking the Robustness of Semantic Segmentation Models CVPR 2020 CLUE: A Chinese Language Understanding Evaluation Benchmark COLING 2020 Effects of Naturalistic Variation in Goal-Oriented Dialog EMNLP 2020 Evaluating Commonsense in Pre-Trained Language Models AAAI 2020 Evaluating Machine Accuracy on ImageNet ICML 2020 Experimental Evaluation and Development of a Silver-Standard for the MIMIC-III Clinical Coding Dataset ACL 2020 From ImageNet to Image Classification: Contextualizing Progress on Benchmarks ICML 2020 Identifying Statistical Bias in Dataset Replication ICML 2020 jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models ACL 2020 Let’s Stop Incorrect Comparisons in End-to-end Relation Extraction! EMNLP 2020 On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law NeurIPS 2020 Span Model for Open Information Extraction on Accurate Corpus AAAI 2020 Taking a Deeper Look at Co-Salient Object Detection CVPR 2020 TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain AAAI 2020 TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification EMNLP 2020 WER we are and WER we think we are EMNLP 2020 XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ICML 2020 Answer Them All! Toward Universal Visual Question Answering Models CVPR 2019 Benchmarking Benchmarks: Introducing New Automatic Indicators for Benchmarking Spoken Language Understanding Corpora Interspeech 2019 Cold Case: The Lost MNIST Digits NeurIPS 2019