Evaluation

Unbiased IoU for Spherical Image Object Detection AAAI 2022 Unmasking the Mask – Evaluating Social Biases in Masked Language Models AAAI 2022 Using Natural Sentence Prompts for Understanding Biases in Language Models NAACL 2022 Using Sampling to Estimate and Improve Performance of Automated Scoring Systems with Guarantees AAAI 2022 Vacillating Human Correlation of SacreBLEU in Unprotected Languages ACL 2022 ViM: Out-of-Distribution With Virtual-Logit Matching CVPR 2022 What are the best Systems? New Perspectives on NLP Benchmarking NeurIPS 2022 What Makes Reading Comprehension Questions Difficult? ACL 2022 What Was Your Name Again? Interrogating Generative Conversational Models For Factual Consistency Evaluation EMNLP 2022 When AI Difficulty Is Easy: The Explanatory Power of Predicting IRT Difficulty AAAI 2022 When AUC meets DRO: Optimizing Partial AUC for Deep Learning with Non-Convex Convergence Guarantee ICML 2022 When does dough become a bagel? Analyzing the remaining mistakes on ImageNet NeurIPS 2022 Which Model is Best: Comparing Methods and Metrics for Automatic Laughter Detection in a Naturalistic Conversational Dataset Interspeech 2022 Why only Micro-F1? Class Weighting of Measures for Relation Classification ACL 2022 X-FACTOR: A Cross-metric Evaluation of Factual Correctness in Abstractive Summarization EMNLP 2022 Accountable Error Characterization NAACL 2021 A Comparative Survey: Benchmarking for Pool-based Active Learning IJCAI 2021 A Comprehensive Assessment of Dialog Evaluation Metrics EMNLP 2021 Active Assessment of Prediction Services as Accuracy Surface Over Attribute Combinations NeurIPS 2021 Active Bayesian Assessment of Black-Box Classifiers AAAI 2021 Active Testing: Sample-Efficient Model Evaluation ICML 2021 A Fine-Grained Analysis of BERTScore EMNLP 2021 Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators’ Disagreement EMNLP 2021 Alibi Explain: Algorithms for Explaining Machine Learning Models JMLR 2021 An Analysis of LIME for Text Data AISTATS 2021