crowdsourced annotation

Assessing Crowdsourced Annotations with LLMs: Linguistic Certainty as a Proxy for Trustworthiness NAACL 2025 Caption Generation in Cultural Heritage: Crowdsourced Data and Tuning Multimodal Large Language Models NAACL 2025 Forbidden FRUIT is the Sweetest: An Annotated Tweets Corpus for French Unfrozen Idioms Identification ACL 2025 Fostering Digital Inclusion for Low-Resource Nigerian Languages: A Case Study of Igbo and Nigerian Pidgin NAACL 2025 Task Configuration Impacts Annotation Quality and Model Training Performance in Crowdsourced Image Segmentation WACV 2025 A Perspectivist Corpus of Numbers in Social Judgements COLING 2024 Automated Detection and Analysis of Data Practices Using A Real-World Corpus ACL 2024 Re-examining Sexism and Misogyny Classification with Annotator Attitudes EMNLP 2024 Revisiting Annotation of Online Gender-Based Violence COLING 2024 Soft-Label Integration for Robust Toxicity Classification NeurIPS 2024 Unbiased Multi-Label Learning from Crowdsourced Annotations ICML 2024 Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback ICLR 2024 Consensus and Subjectivity of Skin Tone Annotation for ML Fairness NeurIPS 2023 Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under Discussion ACL 2023 The distribution of discourse relations within and across turns in spontaneous conversation ACL 2023 Risk-graded Safety for Handling Medical Queries in Conversational AI AACL 2022 That’s so cute!: The CARE Dataset for Affective Response Detection CoNLL 2022 Accounting for Confirmation Bias in Crowdsourced Label Aggregation IJCAI 2021 Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators’ Disagreement EMNLP 2021 IndoNLI: A Natural Language Inference Dataset for Indonesian EMNLP 2021 On Releasing Annotator-Level Labels and Information in Datasets EMNLP 2021 UOR at SemEval-2021 Task 12: On Crowd Annotations; Learning with Disagreements to optimise crowd truth SemEval 2021 Efficient Pairwise Annotation of Argument Quality ACL 2020 Structured Probabilistic End-to-End Learning from Crowds IJCAI 2020 What Can We Learn from Collective Human Opinions on Natural Language Inference Data? EMNLP 2020