bias evaluation

Humans or LLMs as the Judge? A Study on Judgement Bias EMNLP 2024 Investigating Subtler Biases in LLMs: Ageism, Beauty, Institutional, and Nationality Bias in Generative Models ACL 2024 Metrics for What, Metrics for Whom: Assessing Actionability of Bias Evaluation Metrics in NLP EMNLP 2024 More than Minorities and Majorities: Understanding Multilateral Bias in Language Generation ACL 2024 Quite Good, but Not Enough: Nationality Bias in Large Language Models - a Case Study of ChatGPT COLING 2024 Social Bias Probing: Fairness Benchmarking for Language Models EMNLP 2024 Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models ACL 2024 The Generation Gap: Exploring Age Bias in the Value Systems of Large Language Models EMNLP 2024 This Land is Your, My Land: Evaluating Geopolitical Bias in Language Models through Territorial Disputes NAACL 2024 Unmasking Biases: Exploring Gender Bias in English-Catalan Machine Translation through Tokenization Analysis and Novel Dataset COLING 2024 ViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generation ACL 2024 Who is better at math, Jenny or Jingzhen? Uncovering Stereotypes in Large Language Models EMNLP 2024 Whose wife is it anyway? Assessing bias against same-gender relationships in machine translation ACL 2024 Why Don’t Prompt-Based Fairness Metrics Correlate? ACL 2024 Your Stereotypical Mileage May Vary: Practical Challenges of Evaluating Biases in Multiple Languages and Cultural Contexts COLING 2024 Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems EMNLP 2023 Bias Beyond English: Counterfactual Tests for Bias in Sentiment Analysis in Four Languages ACL 2023 CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models ACL 2023 Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples EACL 2023 Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns EACL 2023 DELPHI: Data for Evaluating LLMs’ Performance in Handling Controversial Issues EMNLP 2023 Entity-Based Evaluation of Political Bias in Automatic Summarization EMNLP 2023 Evaluating the Diversity, Equity, and Inclusion of NLP Technology: A Case Study for Indian Languages EACL 2023 FairPrism: Evaluating Fairness-Related Harms in Text Generation ACL 2023 Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model EMNLP 2023