Evaluation

Variance of Average Surprisal: A Better Predictor for Quality of Grammar from Unsupervised PCFG Induction ACL 2019 Verified Uncertainty Calibration NeurIPS 2019 What if We Simply Swap the Two Text Fragments? A Straightforward yet Effective Way to Test the Robustness of Methods to Confounding Signals in Nature Language Inference Tasks AAAI 2019 What made you do this? Understanding black-box decisions with sufficient input subsets AISTATS 2019 WiRe57 : A Fine-Grained Benchmark for Open Information Extraction ACL 2019 A Boo(n) for Evaluating Architecture Performance ICML 2018 A Call for Clarity in Reporting BLEU Scores EMNLP 2018 A Framework for the Quantitative Evaluation of Disentangled Representations ICLR 2018 Algorithmic Assurance: An Active Approach to Algorithmic Testing using Bayesian Optimisation NeurIPS 2018 A Methodology for Evaluating Interaction Strategies of Task-Oriented Conversational Agents EMNLP 2018 Annotation Artifacts in Natural Language Inference Data NAACL 2018 Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation EMNLP 2018 Behavior Analysis of NLI Models: Uncovering the Influence of Three Factors on Robustness NAACL 2018 BLEU is Not Suitable for the Evaluation of Text Simplification EMNLP 2018 Breaking NLI Systems with Sentences that Require Simple Lexical Inferences ACL 2018 Creating a Dataset for Multilingual Fine-grained Emotion-detection Using Gamification-based Annotation EMNLP 2018 Deep learning evaluation using deep linguistic processing NAACL 2018 Efficient Online Scalar Annotation with Bounded Support ACL 2018 Estimating Summary Quality with Pairwise Preferences NAACL 2018 EvalD Reference-Less Discourse Evaluation for WMT18 EMNLP 2018 Exploring gap filling as a cheaper alternative to reading comprehension questionnaires when evaluating machine translation for gisting EMNLP 2018 Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation EMNLP 2018 Improving Text-to-SQL Evaluation Methodology ACL 2018 Inherent Biases in Reference-based Evaluation for Grammatical Error Correction ACL 2018 In Search of Coherence and Consensus: Measuring the Interpretability of Statistical Topics JMLR 2018