Evaluation

Predicting Deep Neural Network Generalization with Perturbation Response Curves NeurIPS 2021 Pre-train or Annotate? Domain Adaptation with a Constrained Budget EMNLP 2021 Probing Language Models for Understanding of Temporal Expressions EMNLP 2021 ProSPer: Probing Human and Neural Network Language Model Understanding of Spatial Perspective EMNLP 2021 Proxy Indicators for the Quality of Open-domain Dialogues EMNLP 2021 Pushing the Right Buttons: Adversarial Evaluation of Quality Estimation EMNLP 2021 Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets EACL 2021 Regressive Ensemble for Machine Translation Quality Evaluation EMNLP 2021 Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain EMNLP 2021 Re-TACRED: Addressing Shortcomings of the TACRED Dataset AAAI 2021 Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding Interspeech 2021 Revisiting Parity of Human vs. Machine Conversational Speech Transcription Interspeech 2021 RoBLEURT Submission for WMT2021 Metrics Task EMNLP 2021 Robustness Evaluation of Entity Disambiguation Using Prior Probes: the Case of Entity Overshadowing EMNLP 2021 Robustness Gym: Unifying the NLP Evaluation Landscape NAACL 2021 Semantics Altering Modifications for Evaluating Comprehension in Machine Reading AAAI 2021 Separating Retention from Extraction in the Evaluation of End-to-end Relation Extraction EMNLP 2021 SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluation EMNLP 2021 Shades of BLEU, Flavours of Success: The Case of MultiWOZ ACL 2021 Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning EMNLP 2021 Simpson's Bias in NLP Training AAAI 2021 Sometimes We Want Ungrammatical Translations EMNLP 2021 SOPE: Spectrum of Off-Policy Estimators NeurIPS 2021 Speaker-Conversation Factorial Designs for Diarization Error Analysis Interspeech 2021 Speaking with a KN95 Face Mask: ASR Performance and Speaker Compensation Interspeech 2021