Evaluation

What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think EMNLP 2021 What Matters for On-Policy Deep Actor-Critic Methods? A Large-Scale Study ICLR 2021 When Do You Need Billions of Words of Pretraining Data? ACL 2021 Adversarial NLI: A New Benchmark for Natural Language Understanding ACL 2020 Analyzing Neural Discourse Coherence Models EMNLP 2020 Assessing Human-Parity in Machine Translation on the Segment Level EMNLP 2020 Attention is Not Only a Weight: Analyzing Transformers with Vector Norms EMNLP 2020 Attribution in Scale and Space CVPR 2020 Beyond Accuracy: Behavioral Testing of NLP Models with CheckList ACL 2020 Building Calibrated Deep Models via Uncertainty Matching with Auxiliary Interval Predictors AAAI 2020 Computing the Testing Error Without a Testing Set CVPR 2020 Dataless Model Selection With the Deep Frame Potential CVPR 2020 Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics EMNLP 2020 diagNNose: A Library for Neural Activation Analysis EMNLP 2020 Effectively Unbiased FID and Inception Score and Where to Find Them CVPR 2020 Facet-Aware Evaluation for Extractive Summarization ACL 2020 Gradient-based Analysis of NLP Models is Manipulable EMNLP 2020 Identifying Model Weakness with Adversarial Examiner AAAI 2020 Interpretability and Analysis in Neural NLP ACL 2020 Intra Order-preserving Functions for Calibration of Multi-Class Neural Networks NeurIPS 2020 Learning to Evaluate Perception Models Using Planner-Centric Metrics CVPR 2020 ML-LOO: Detecting Adversarial Examples with Feature Attribution AAAI 2020 MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics EMNLP 2020 NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search ICLR 2020 Neuron Shapley: Discovering the Responsible Neurons NeurIPS 2020