conftrace_

annotation disagreement

39 papers

Explore in graph

Co-occurring keywords · papers mentioning both

inter-annotator agreement (8) text classification (7) large language model (6) natural language inference (6) annotator disagreement (4) subjective task (3) human annotation (3) label noise (3) natural language processing (3) ensemble learning (3)

Papers

Constructing a Japanese Verdict Prediction Dataset for Fact-Checking of LLM-Generated Texts ACL 2026 Ambiguity and Disagreement in Abstract Meaning Representation COLING 2025 Another Approach to Agreement Measurement and Prediction with Emotion Annotations ACL 2025 BoN Appetit Team at LeWiDi-2025: Best-of-N Test-time Scaling Can Not Stomach Annotation Disagreements (Yet) EMNLP 2025 Disagreements in analyses of rhetorical text structure: A new dataset and first analyses ACL 2025 From Disagreement to Understanding: The Case for Ambiguity Detection in NLI EMNLP 2025 Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement ACL 2025 Learning from Disagreement: Entropy-Guided Few-Shot Selection for Toxic Language Detection ACL 2025 Mining the uncertainty patterns of humans and models in the annotation of moral foundations and human values ACL 2025 NUTMEG: Separating Signal From Noise in Annotator Disagreement EMNLP 2025 Proposal: From One-Fit-All to Perspective Aware Modeling ACL 2025 That is Unacceptable: the Moral Foundations of Canceling ACL 2025 Towards Multi-Perspective NLP Systems: A Thesis Proposal ACL 2025 Disagreement in Argumentation Annotation COLING 2024 Don’t Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations EACL 2024 Evaluating the Development of Linguistic Metaphor Annotation in Mexican Spanish Popular Science Tweets NAACL 2024 Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis NAACL 2024 GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives NAACL 2024 The Empirical Variability of Narrative Perceptions of Social Media Texts EMNLP 2024 CICL_DMS at SemEval-2023 Task 11: Learning With Disagreements (Le-Wi-Di) SemEval 2023 Confidence-based Ensembling of Perspective-aware Models EMNLP 2023 Don’t waste a single annotation: improving single-label classifiers through soft labels EMNLP 2023 Dragonfly_captain at SemEval-2023 Task 11: Unpacking Disagreement with Investigation of Annotator Demographics and Task Difficulty SemEval 2023 Ecologically Valid Explanations for Label Variation in NLI EMNLP 2023 eevvgg at SemEval-2023 Task 11: Offensive Language Classification with Rater-based Information SemEval 2023