Evaluation

Intersection-Validation: A Method for Evaluating Structure Learning without Ground Truth AISTATS 2018 Lessons from the Bible on Modern Topics: Low-Resource Multilingual Topic Model Evaluation NAACL 2018 Locally Private Hypothesis Testing ICML 2018 Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research JMLR 2018 MeSH-based dataset for measuring the relevance of text retrieval ACL 2018 Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Task ACL 2018 Neural Quality Estimation of Grammatical Error Correction EMNLP 2018 On the Efficiency of Data Collection for Crowdsourced Classification IJCAI 2018 On the Impact of Various Types of Noise on Neural Machine Translation ACL 2018 Practical Methods for Graph Two-Sample Testing NeurIPS 2018 Precision and Recall for Time Series NeurIPS 2018 Reference-less Measure of Faithfulness for Grammatical Error Correction NAACL 2018 Report of NEWS 2018 Named Entity Transliteration Shared Task ACL 2018 Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance EMNLP 2018 Semantic Structural Evaluation for Text Simplification NAACL 2018 Sentence-Level Fluency Evaluation: References Help, But Can Be Spared! CoNLL 2018 Tackling the Story Ending Biases in The Story Cloze Test ACL 2018 Taylor’s law for Human Linguistic Sequences ACL 2018 The Hitchhiker’s Guide to Testing Statistical Significance in Natural Language Processing ACL 2018 The Importance of Calibration for Estimating Proportions from Annotations NAACL 2018 The price of debiasing automatic metrics in natural language evalaution ACL 2018 Topic Intrusion for Automatic Topic Model Evaluation EMNLP 2018 Towards a Better Metric for Evaluating Question Generation Systems EMNLP 2018 Using Universal Dependencies in cross-linguistic complexity research EMNLP 2018 Whistle-blowing ASRs: Evaluating the Need for More Inclusive Speech Recognition Systems Interspeech 2018