Evaluation

Linguistic Evaluation of German-English Machine Translation Using a Test Suite ACL 2019 Lost in Evaluation: Misleading Benchmarks for Bilingual Dictionary Induction EMNLP 2019 Minimizers of the Empirical Risk and Risk Monotonicity NeurIPS 2019 Misleading Failures of Partial-input Baselines ACL 2019 Modeling language learning using specialized Elo rating ACL 2019 Morpho-MNIST: Quantitative Assessment and Diagnostics for Representation Learning JMLR 2019 MOSNet: Deep Learning-Based Objective Assessment for Voice Conversion Interspeech 2019 MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance EMNLP 2019 Multiclass Performance Metric Elicitation NeurIPS 2019 Narrative Generation in the Wild: Methods from NaNoGenMo ACL 2019 Number Sequence Prediction Problems for Evaluating Computational Powers of Neural Networks AAAI 2019 On Making Reading Comprehension More Comprehensive EMNLP 2019 On Understanding the Relation between Expert Annotations of Text Readability and Target Reader Comprehension ACL 2019 Optimal Testing in the Experiment-rich Regime AISTATS 2019 Performance Evaluation in Machine Learning: The Good, the Bad, the Ugly, and the Way Forward AAAI 2019 Rethinking the Evaluation of Video Summaries CVPR 2019 SAO WMT19 Test Suite: Machine Translation of Audit Reports ACL 2019 Selection Bias Explorations and Debias Methods for Natural Language Sentence Matching Datasets ACL 2019 SemBleu: A Robust Metric for AMR Parsing Evaluation ACL 2019 SherLIiC: A Typed Event-Focused Lexical Inference Benchmark for Evaluating Natural Language Inference ACL 2019 Studying Summarization Evaluation Metrics in the Appropriate Scoring Range ACL 2019 The Feasibility of Embedding Based Automatic Evaluation for Single Document Summarization EMNLP 2019 The MuCoW Test Suite at WMT 2019: Automatically Harvested Multilingual Contrastive Word Sense Disambiguation Test Sets for Machine Translation ACL 2019 Tightness-Aware Evaluation Protocol for Scene Text Detection CVPR 2019 Unreproducible Research is Reproducible ICML 2019