model evaluation

Your fairness may vary: Pretrained language model fairness in toxic text classification ACL 2022 A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist EACL 2021 Active Assessment of Prediction Services as Accuracy Surface Over Attribute Combinations NeurIPS 2021 Active Testing: Sample-Efficient Model Evaluation ICML 2021 Anatomy of OntoGUM—Adapting GUM to the OntoNotes Scheme to Evaluate Robustness of SOTA Coreference Algorithms EMNLP 2021 Are Labels Always Necessary for Classifier Accuracy Evaluation? CVPR 2021 Are NLP Models really able to Solve Simple Math Word Problems? NAACL 2021 Beyond Accuracy: Behavioral Testing of NLP Models with Checklist (Extended Abstract) IJCAI 2021 Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers EMNLP 2021 Choose Your Own Adventure: Paired Suggestions in Collaborative Writing for Evaluating Story Generation Models NAACL 2021 CrossCheck: Rapid, Reproducible, and Interpretable Model Evaluation NAACL 2021 Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking NeurIPS 2021 Evaluating Deception Detection Model Robustness To Linguistic Variation NAACL 2021 Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards? ACL 2021 ExplainaBoard: An Explainable Leaderboard for NLP ACL 2021 Guiding Principles for Participatory Design-inspired Natural Language Processing ACL 2021 HateCheck: Functional Tests for Hate Speech Detection Models ACL 2021 How Robust are Model Rankings : A Leaderboard Customization Approach for Equitable Evaluation AAAI 2021 Mandoline: Model Evaluation under Distribution Shift ICML 2021 Memorization vs. Generalization : Quantifying Data Leakage in NLP Performance Evaluation EACL 2021 Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing CVPR 2021 Perceptual Score: What Data Modalities Does Your Model Perceive? NeurIPS 2021 Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models ACL 2021 SyMetric: Measuring the Quality of Learnt Hamiltonian Dynamics Inferred from Vision NeurIPS 2021 Themis: A Fair Evaluation Platform for Computer Vision Competitions IJCAI 2021