annotation bia

Causal Direct Preference Optimization for Language Model Alignment EACL 2026 Aligning NLP Models with Target Population Perspectives using PAIR: Population-Aligned Instance Replication EMNLP 2025 Conflicts in Texts: Data, Implications and Challenges EMNLP 2025 DefVerify: Do Hate Speech Models Reflect Their Dataset’s Definition? COLING 2025 Learning Subjective Label Distributions via Sociocultural Descriptors EMNLP 2025 Understanding Annotator Perception: Modeling Psychological Inference from First- and Third-Person Annotations (Student Abstract) AAAI 2025 Which Demographics do LLMs Default to During Annotation? ACL 2025 Identifying and Mitigating Annotation Bias in Natural Language Understanding using Causal Mediation Analysis ACL 2024 Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting EACL 2024 Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US EMNLP 2024 Whose Preferences? Differences in Fairness Preferences and Their Impact on the Fairness of AI Utilizing Human Feedback ACL 2024 NLPositionality: Characterizing Design Biases of Datasets and Models ACL 2023 Evaluation of Summarization Systems across Gender, Age, and Race EMNLP 2021 Guideline Bias in Wizard-of-Oz Dialogues ACL 2021 Towards Equal Gender Representation in the Annotations of Toxic Language Detection ACL 2021 Understanding and Mitigating Annotation Bias in Facial Expression Recognition ICCV 2021 The Risk of Racial Bias in Hate Speech Detection ACL 2019 ConStance: Modeling Annotation Contexts to Improve Stance Classification EMNLP 2017