fairness evaluation

STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions EMNLP 2024 SureMap: Simultaneous mean estimation for single-task and multi-task disaggregated evaluation NeurIPS 2024 Towards measuring fairness in speech recognition: Fair-Speech dataset Interspeech 2024 Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps EMNLP 2024 Understanding Position Bias Effects on Fairness in Social Multi-Document Summarization NAACL 2024 “You Gotta be a Doctor, Lin” : An Investigation of Name-Based Bias of Large Language Models in Employment Recommendations EMNLP 2024 Bias On Demand: Investigating Bias with a Synthetic Data Generator IJCAI 2023 Bridging the Digital Divide: Performance Variation across Socio-Economic Factors in Vision-Language Models EMNLP 2023 Building Socio-culturally Inclusive Stereotype Resources with Community Engagement NeurIPS 2023 Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP EACL 2023 Fairness in Language Models Beyond English: Gaps and Challenges EACL 2023 GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognition NeurIPS 2023 In-Depth Look at Word Filling Societal Bias Measures EACL 2023 Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey EACL 2023 LUCID: Exposing Algorithmic Bias through Inverse Design AAAI 2023 MixFairFace: Towards Ultimate Fairness via MixFair Adapter in Face Recognition AAAI 2023 Race, Gender, and Age Biases in Biomedical Masked Language Models ACL 2023 ROBBIE: Robust Bias Evaluation of Large Generative Language Models EMNLP 2023 Uncovering and Quantifying Social Biases in Code Generation NeurIPS 2023 Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributes ICML 2023 Whose Opinions Do Language Models Reflect? ICML 2023 WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models ACL 2023 An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models ACL 2022 Benchmarking Intersectional Biases in NLP NAACL 2022 FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing ACL 2022