Evaluation

AUC Optimization with a Reject Option AAAI 2020 Automatic Evaluation vs. User Preference in Neural Textual QuestionAnswering over COVID-19 Scientific Literature EMNLP 2020 Benchmarking the Robustness of Semantic Segmentation Models CVPR 2020 Beyond Accuracy: Behavioral Testing of NLP Models with CheckList ACL 2020 Beyond User Self-Reported Likert Scale Ratings: A Comparison Model for Automatic Dialog Evaluation ACL 2020 Calibration of Pre-trained Transformers EMNLP 2020 COGS: A Compositional Generalization Challenge Based on Semantic Interpretation EMNLP 2020 Controlled Crowdsourcing for High-Quality QA-SRL Annotation ACL 2020 Cross-validation Confidence Intervals for Test Error NeurIPS 2020 Dataless Model Selection With the Deep Frame Potential CVPR 2020 Designing Precise and Robust Dialogue Response Evaluators ACL 2020 Does the Objective Matter? Comparing Training Objectives for Pronoun Resolution EMNLP 2020 Dscorer: A Fast Evaluation Metric for Discourse Representation Structure Parsing ACL 2020 Effectively Unbiased FID and Inception Score and Where to Find Them CVPR 2020 Effects of Naturalistic Variation in Goal-Oriented Dialog EMNLP 2020 Evaluating and Aggregating Feature-based Model Explanations IJCAI 2020 Evaluating Explanation Methods for Neural Machine Translation ACL 2020 Evaluating Models’ Local Decision Boundaries via Contrast Sets EMNLP 2020 Evaluating the Performance of Reinforcement Learning Algorithms ICML 2020 Evaluation of Causal Structure Learning Algorithms via Risk Estimation UAI 2020 Evaluation of Coreference Resolution Systems Under Adversarial Attacks EMNLP 2020 Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data EMNLP 2020 Facet-Aware Evaluation for Extractive Summarization ACL 2020 Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks AAAI 2020 Grammaticality and Language Modelling EMNLP 2020