Evaluation

Improving Reproducibility in Machine Learning Research(A Report from the NeurIPS 2019 Reproducibility Program) JMLR 2021 IndoNLI: A Natural Language Inference Dataset for Indonesian EMNLP 2021 Is this the end of the gold standard? A straightforward reference-less grammatical error correction metric EMNLP 2021 Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases ACL 2021 Language Model Evaluation Beyond Perplexity ACL 2021 Learning Curves for Analysis of Deep Networks ICML 2021 Learning Prediction Intervals for Model Performance AAAI 2021 Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German EMNLP 2021 Marginal Contribution Feature Importance - an Axiomatic Approach for Explaining Data ICML 2021 Measuring and Improving Model-Moderator Collaboration using Uncertainty Estimation ACL 2021 Measuring Conversational Uptake: A Case Study on Student-Teacher Interactions ACL 2021 Memorization vs. Generalization : Quantifying Data Leakage in NLP Performance Evaluation EACL 2021 Meta-Cal: Well-controlled Post-hoc Calibration by Ranking ICML 2021 Model updating after interventions paradoxically introduces bias AISTATS 2021 MTEQA at WMT21 Metrics Shared Task EMNLP 2021 MultiLexNorm: A Shared Task on Multilingual Lexical Normalization EMNLP 2021 Multilingual Machine Translation Evaluation Metrics Fine-tuned on Pseudo-Negative Examples for WMT 2021 Metrics Task EMNLP 2021 Neural Side-by-Side: Predicting Human Preferences for No-Reference Super-Resolution Evaluation CVPR 2021 Numerical reasoning in machine reading comprehension tasks: are we there yet? EMNLP 2021 On Estimating Recommendation Evaluation Metrics under Sampling AAAI 2021 On the Effects of Transformer Size on In- and Out-of-Domain Calibration EMNLP 2021 On the Stability of System Rankings at WMT EMNLP 2021 OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics ACL 2021 Out of a Hundred Trials, How Many Errors Does Your Speaker Verifier Make? Interspeech 2021 Perception Score: A Learned Metric for Open-ended Text Generation Evaluation AAAI 2021