dataset evaluation

Comparing Test Sets with Item Response Theory ACL 2021 Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets EACL 2021 Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models EMNLP 2021 What Would it Take to get Biomedical QA Systems into Practice? EMNLP 2021 A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers ACL 2020 A guide to the dataset explosion in QA, NLI, and commonsense reasoning COLING 2020 An empirical analysis of existing systems and datasets toward general simple question answering COLING 2020 Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets AAAI 2020 TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task ACL 2020 What do Models Learn from Question Answering Datasets? EMNLP 2020 Aiming beyond the Obvious: Identifying Non-Obvious Cases in Semantic Similarity Datasets ACL 2019 Misleading Failures of Partial-input Baselines ACL 2019 On Making Reading Comprehension More Comprehensive EMNLP 2019 Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets EMNLP 2019 Evaluation Metrics for Machine Reading Comprehension: Prerequisite Skills and Readability ACL 2017 Semantic overfitting: what ‘world’ do we consider when evaluating disambiguation of text? COLING 2016 Boosting Object Proposals: From Pascal to COCO ICCV 2015 CV-HAZOP: Introducing Test Data Validation for Computer Vision ICCV 2015 Depth-Based Hand Pose Estimation: Data, Methods, and Challenges ICCV 2015 The Secrets of Salient Object Segmentation CVPR 2014 Boundary Detection Benchmarking: Beyond F-Measures CVPR 2013