benchmark evaluation

EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language Inference CoNLL 2019 Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations EMNLP 2019 GSLAM: A General SLAM Framework and Benchmark ICCV 2019 How Reasonable are Common-Sense Reasoning Tasks: A Case-Study on the Winograd Schema Challenge and SWAG EMNLP 2019 How Well Do Machines Perform on IQ tests: a Comparison Study on a Large-Scale Dataset IJCAI 2019 Lost in Evaluation: Misleading Benchmarks for Bilingual Dictionary Induction EMNLP 2019 Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning CoRL 2019 Model Similarity Mitigates Test Set Overuse NeurIPS 2019 On Zero-Shot Recognition of Generic Objects CVPR 2019 Open Problem: How fast can a multiclass test set be overfit? COLT 2019 Rethinking the Evaluation of Video Summaries CVPR 2019 Revisiting the Evaluation of Theory of Mind through Question Answering EMNLP 2019 Single Image Deraining: A Comprehensive Benchmark Analysis CVPR 2019 Testing the Generalization Power of Neural Network Models across NLI Benchmarks ACL 2019 The advantages of multiple classes for reducing overfitting from test set reuse ICML 2019 Towards GAN Benchmarks Which Require Generalization ICLR 2019 What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis ICCV 2019 When Choosing Plausible Alternatives, Clever Hans can be Clever EMNLP 2019 How Much Reading Does Reading Comprehension Require? A Critical Investigation of Popular Benchmarks EMNLP 2018 Is ATIS Too Shallow to Go Deeper for Benchmarking Spoken Language Understanding Models? Interspeech 2018 Realistic Evaluation of Deep Semi-Supervised Learning Algorithms NeurIPS 2018 Re-evaluating evaluation NeurIPS 2018 Report of NEWS 2018 Named Entity Transliteration Shared Task ACL 2018 Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking CVPR 2018 SimpleQuestions Nearly Solved: A New Upperbound and Baseline Approach EMNLP 2018