Evaluation

On the Robustness of Language Encoders against Grammatical Errors ACL 2020 On the Same Page? Comparing Inter-Annotator Agreement in Sentence and Document Level Human Machine Translation Evaluation EMNLP 2020 Optimization and Analysis of the pAp@k Metric for Recommender Systems ICML 2020 Overview of the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies ACL 2020 Predicting Performance for Natural Language Processing Tasks ACL 2020 Predictive Engagement: An Efficient Metric for Automatic Evaluation of Open-Domain Dialogue Systems AAAI 2020 Probabilistic Extension of Precision, Recall, and F1 Score for More Thorough Evaluation of Classification Models EMNLP 2020 Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling EMNLP 2020 Probing Linguistic Systematicity ACL 2020 Probing Pretrained Language Models for Lexical Semantics EMNLP 2020 Probing Task-Oriented Dialogue Representation from Language Models EMNLP 2020 Quantifying the Evaluation of Heuristic Methods for Textual Data Augmentation EMNLP 2020 R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason ACL 2020 Reliable Fidelity and Diversity Metrics for Generative Models ICML 2020 RoFT: A Tool for Evaluating Human Detection of Machine-Generated Text EMNLP 2020 SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics EMNLP 2020 Semi-Supervised Learning for Maximizing the Partial AUC AAAI 2020 Small but Mighty: New Benchmarks for Split and Rephrase EMNLP 2020 Some Languages Seem Easier to Parse Because Their Treebanks Leak EMNLP 2020 Speaker Sensitive Response Evaluation Model ACL 2020 Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems EMNLP 2020 SQE: a Self Quality Evaluation Metric for Parameters Optimization in Multi-Object Tracking CVPR 2020 Stable Regression: On the Power of Optimization over Randomization JMLR 2020 SyntaxGym: An Online Platform for Targeted Evaluation of Language Models ACL 2020 TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task ACL 2020