fairness evaluation

FairLib: A Unified Framework for Assessing and Improving Fairness EMNLP 2022 Fairness in Representation for Multilingual NLP: Insights from Controlled Experiments on Conditional Language Modeling ICLR 2022 French CrowS-Pairs: Extending a challenge dataset for measuring social bias in masked language models to a language other than English ACL 2022 “I’m sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor Dataset EMNLP 2022 Measuring Fairness with Biased Rulers: A Comparative Study on Bias Metrics for Pre-trained Language Models NAACL 2022 On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representations ACL 2022 Quantifying Societal Bias Amplification in Image Captioning CVPR 2022 Re-contextualizing Fairness in NLP: The Case of India AACL 2022 Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluation NeurIPS 2022 Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation ACL 2022 Bad Seeds: Evaluating Lexical Methods for Bias Measurement ACL 2021 Constructing a Psychometric Testbed for Fair Natural Language Processing EMNLP 2021 Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021 Reliability Testing for Natural Language Processing Systems ACL 2021 StereoSet: Measuring stereotypical bias in pretrained language models ACL 2021 Themis: A Fair Evaluation Platform for Computer Vision Competitions IJCAI 2021 Certifai: A Toolkit for Building Trust in AI Systems IJCAI 2020 Fairness Evaluation in Presence of Biased Noisy Labels AISTATS 2020 FuzzE: Fuzzy Fairness Evaluation of Offensive Language Classifiers on African-American English AAAI 2020 A Transparent Framework for Evaluating Unintended Demographic Bias in Word Embeddings ACL 2019 Evaluating Gender Bias in Machine Translation ACL 2019