Evaluation

Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI EMNLP 2021 Differential Evaluation: a Qualitative Analysis of Natural Language Processing System Behavior Based Upon Data Resistance to Processing EMNLP 2021 Does She Wink or Does She Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models EACL 2021 Do Language Models Know the Way to Rome? EMNLP 2021 Enriching ImageNet With Human Similarity Judgments and Psychological Embeddings CVPR 2021 Error-Sensitive Evaluation for Ordinal Target Variables EMNLP 2021 Evaluating Evaluation Measures for Ordinal Classification and Ordinal Quantification ACL 2021 Evaluating the Evaluation of Diversity in Natural Language Generation EACL 2021 Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards? ACL 2021 Evaluation Guidelines to Deal with Implicit Phenomena to Assess Factuality in Data-to-Text Generation ACL 2021 Evaluation of Unsupervised Automatic Readability Assessors Using Rank Correlations EMNLP 2021 Evaluation Scheme of Focal Translation for Japanese Partially Amended Statutes ACL 2021 Expected Validation Performance and Estimation of a Random Variable’s Maximum EMNLP 2021 ExplainaBoard: An Explainable Leaderboard for NLP ACL 2021 Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation EMNLP 2021 Finding a Balanced Degree of Automation for Summary Evaluation EMNLP 2021 Findings of the WMT 2021 Shared Task on Quality Estimation EMNLP 2021 GCDF1: A Goal- and Context- Driven F-Score for Evaluating User Models EMNLP 2021 Generalization in Portfolio-Based Algorithm Selection AAAI 2021 Have Fun Storming the Castle(s)! WACV 2021 Have We Learned to Explain?: How Interpretability Methods Can Learn to Encode Predictions in their Interpretations. AISTATS 2021 How Good (really) are Grammatical Error Correction Systems? EACL 2021 How Might We Create Better Benchmarks for Speech Recognition? ACL 2021 How much coffee was consumed during EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI EMNLP 2021 Human-Model Divergence in the Handling of Vagueness ACL 2021