Evaluation

Temporal Reasoning in Natural Language Inference EMNLP 2020 Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimates ACL 2020 The Sensitivity of Language Models and Humans to Winograd Schema Perturbations ACL 2020 Top-Rank-Focused Adaptive Vote Collection for the Evaluation of Domain-Specific Semantic Models EMNLP 2020 Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation ACL 2020 Tuning Causal Discovery Algorithms PGM 2020 uBLEU: Uncertainty-Aware Automatic Evaluation Method for Open-Domain Dialogue Systems ACL 2020 Using PRMSE to evaluate automated scoring systems in the presence of label noise ACL 2020 Utility is in the Eye of the User: A Critique of NLP Leaderboards EMNLP 2020 WER we are and WER we think we are EMNLP 2020 What Can We Learn from Collective Human Opinions on Natural Language Inference Data? EMNLP 2020 What do we expect from Multiple-choice QA Systems? EMNLP 2020 What Question Answering can Learn from Trivia Nerds ACL 2020 X-CAL: Explicit Calibration for Survival Analysis NeurIPS 2020 Accurate Layerwise Interpretable Competence Estimation NeurIPS 2019 A Closer Look at Data Bias in Neural Extractive Summarization Models EMNLP 2019 Aiming beyond the Obvious: Identifying Non-Obvious Cases in Semantic Similarity Datasets ACL 2019 A Meta-Analysis of Overfitting in Machine Learning NeurIPS 2019 A Neurobiological Evaluation Metric for Neural Network Model Search CVPR 2019 A Repository of Conversational Datasets ACL 2019 Are Red Roses Red? Evaluating Consistency of Question-Answering Models ACL 2019 A Resource-Free Evaluation Metric for Cross-Lingual Word Embeddings Based on Graph Modularity ACL 2019 A Test Suite and Manual Evaluation of Document-Level NMT at WMT19 ACL 2019 Automatic Grammatical Error Correction for Sequence-to-sequence Text Generation: An Empirical Study ACL 2019 Benchmarking Benchmarks: Introducing New Automatic Indicators for Benchmarking Spoken Language Understanding Corpora Interspeech 2019