evaluation methodology

We Need to Talk About train-dev-test Splits EMNLP 2021 An Evaluation Method for Diachronic Word Sense Induction EMNLP 2020 Evaluating the Performance of Reinforcement Learning Algorithms ICML 2020 If You Build Your Own NER Scorer, Non-replicable Results Will Come EMNLP 2020 Let’s Stop Incorrect Comparisons in End-to-end Relation Extraction! EMNLP 2020 On Importance Sampling-Based Evaluation of Latent Language Models ACL 2020 Would you describe a leopard as yellow? Evaluating crowd-annotations with justified and informative disagreement COLING 2020 Bias Analysis and Mitigation in the Evaluation of Authorship Verification ACL 2019 Fine-Grained Evaluation for Entity Linking EMNLP 2019 Pitfalls in the Evaluation of Sentence Embeddings ACL 2019 Rethinking the Evaluation of Video Summaries CVPR 2019 We Need to Talk about Standard Splits ACL 2019 A Methodology for Evaluating Interaction Strategies of Task-Oriented Conversational Agents EMNLP 2018 Coming to Your Senses: on Controls and Evaluation Sets in Polysemy Research EMNLP 2018 Deep learning evaluation using deep linguistic processing NAACL 2018 Evaluating Multiple System Summary Lengths: A Case Study EMNLP 2018 Improving Text-to-SQL Evaluation Methodology ACL 2018 Re-evaluating evaluation NeurIPS 2018 Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents (Extended Abstract) IJCAI 2018 Systematic Study of Long Tail Phenomena in Entity Linking COLING 2018 The Hitchhiker’s Guide to Testing Statistical Significance in Natural Language Processing ACL 2018 The Word Analogy Testing Caveat NAACL 2018 A Multifaceted Evaluation of Neural versus Phrase-Based Machine Translation for 9 Language Directions EACL 2017 Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation EMNLP 2017 How much progress have we made on RST discourse parsing? A replication study of recent results on the RST-DT EMNLP 2017