inter-annotator disagreement

Disagreement in Metaphor Annotation of Mexican Spanish Science Tweets COLING 2025 Prompting Metaphoricity: Soft Labeling with Large Language Models in Popular Communication of Science Tweets in Spanish ACL 2025 A General Model for Aggregating Annotations AcrossSimple, Complex, and Multi-object Annotation Tasks (Abstract Reprint) AAAI 2024 Modelling Variability in Human Annotator Simulation ACL 2024 From Dissonance to Insights: Dissecting Disagreements in Rationale Construction for Case Outcome Classification EMNLP 2023 SemEval-2023 Task 11: Learning with Disagreements (LeWiDi) SemEval 2023 You Are What You Annotate: Towards Better Models through Annotator Representations EMNLP 2023 The “Problem” of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation EMNLP 2022 Unifying Data Perspectivism and Personalization: An Application to Social Norms EMNLP 2022 Aggregating and Learning from Multiple Annotators EACL 2021 Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output CoNLL 2021 Imprecise Oracles Impose Limits to Predictability in Supervised Learning (Extended Abstract) IJCAI 2021 MATILDA - Multi-AnnoTator multi-language InteractiveLight-weight Dialogue Annotator EACL 2021 SemEval-2021 Task 12: Learning with Disagreements SemEval 2021 A Crowdsourced Frame Disambiguation Corpus with Ambiguity NAACL 2019 LIDA: Lightweight Interactive Dialogue Annotator EMNLP 2019