conftrace_

dataset evaluation

48 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) natural language understanding (846) question answering (2963) text classification (6793) machine reading comprehension (430) named entity recognition (2813) relation extraction (919) natural language inference (1287) annotation error (22) dataset annotation (72)

Papers

Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking EMNLP 2021
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets EACL 2021
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models EMNLP 2021
Comparing Test Sets with Item Response Theory ACL 2021
What Would it Take to get Biomedical QA Systems into Practice? EMNLP 2021
A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers ACL 2020
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets AAAI 2020
A guide to the dataset explosion in QA, NLI, and commonsense reasoning COLING 2020
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task ACL 2020
An empirical analysis of existing systems and datasets toward general simple question answering COLING 2020
What do Models Learn from Question Answering Datasets? EMNLP 2020
Misleading Failures of Partial-input Baselines ACL 2019
Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets IJCNLP 2019
On Making Reading Comprehension More Comprehensive EMNLP 2019
Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets EMNLP 2019
Aiming beyond the Obvious: Identifying Non-Obvious Cases in Semantic Similarity Datasets ACL 2019
Evaluation Metrics for Machine Reading Comprehension: Prerequisite Skills and Readability ACL 2017
Semantic overfitting: what ‘world’ do we consider when evaluating disambiguation of text? COLING 2016
Boosting Object Proposals: From Pascal to COCO ICCV 2015
CV-HAZOP: Introducing Test Data Validation for Computer Vision ICCV 2015
Depth-Based Hand Pose Estimation: Data, Methods, and Challenges ICCV 2015
The Secrets of Salient Object Segmentation CVPR 2014
Boundary Detection Benchmarking: Beyond F-Measures CVPR 2013