Evaluation

ESTIME: Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings EMNLP 2021 Exploratory Model Analysis Using Data-Driven Neuron Representations EMNLP 2021 HateCheck: Functional Tests for Hate Speech Detection Models ACL 2021 How Does BERT Rerank Passages? An Attribution Analysis with Information Bottlenecks EMNLP 2021 Just Ask! Evaluating Machine Translation by Asking and Answering Questions EMNLP 2021 LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing ACL 2021 Lower Perplexity is Not Always Human-Like ACL 2021 Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids’ Representations EMNLP 2021 Not all parameters are born equal: Attention is mostly what you need EMNLP 2021 On the Difficulty of Membership Inference Attacks CVPR 2021 On the Limits of Minimal Pairs in Contrastive Evaluation EMNLP 2021 Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing CVPR 2021 Perception Score: A Learned Metric for Open-ended Text Generation Evaluation AAAI 2021 Probing Across Time: What Does RoBERTa Know and When? EMNLP 2021 Ranking Neural Checkpoints CVPR 2021 Representer Point Selection via Local Jacobian Expansion for Post-hoc Classifier Explanation of Deep Neural Networks and Ensemble Models NeurIPS 2021 Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning EMNLP 2021 Testing Cross-Database Semantic Parsers With Canonical Utterances EMNLP 2021 TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing ACL 2021 The CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis Resolution in Dialogue: A Cross-Team Analysis EMNLP 2021 To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation EMNLP 2021 Trainable Ranking Models to Evaluate the Semantic Accuracy of Data-to-Text Neural Generator EMNLP 2021 TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation EMNLP 2021 Verifiability and Predictability: Interpreting Utilities of Network Architectures for Point Cloud Processing CVPR 2021 We Need to Talk About train-dev-test Splits EMNLP 2021