crowd sourcing

Aggregating Crowd of LLMs for Cost-Effective Data Annotation EACL 2026 Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge ACL 2025 Label Distribution Propagation-based Label Completion for Crowdsourcing ICML 2025 TLLC: Transfer Learning-based Label Completion for Crowdsourcing ICML 2025 Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference ICML 2024 The Empirical Variability of Narrative Perceptions of Social Media Texts EMNLP 2024 A Crowd-AI Collaborative Duo Relational Graph Learning Framework towards Social Impact Aware Photo Classification AAAI 2023 When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Dataset ACL 2023 Dynamic Incentive Mechanism Design for COVID-19 Social Distancing AAAI 2022 InferES : A Natural Language Inference Corpus for Spanish Featuring Negation-Based Contrastive and Adversarial Examples COLING 2022 One for All: Simultaneous Metric and Preference Learning over Multiple Users NeurIPS 2022 Bike-Repositioning Using Volunteers: Crowd Sourcing with Choice Restriction AAAI 2021 CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset EMNLP 2021 FAST: Fast Annotation tool for SmarT devices EMNLP 2021 UOR at SemEval-2021 Task 12: On Crowd Annotations; Learning with Disagreements to optimise crowd truth SemEval 2021 CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Dataset ACL 2020 Interactive Learning with Proactive Cognition Enhancement for Crowd Workers AAAI 2020 AlpacaTag: An Active Learning-based Crowd Annotation Framework for Sequence Tagging ACL 2019 Context Embedding Networks CVPR 2018 Effective Crowdsourcing for a New Type of Summarization Task NAACL 2018 Statistical Quality Control for Human Computation and Crowdsourcing IJCAI 2018 The Many Benefits of Annotator Rationales for Relevance Judgments IJCAI 2017 Automatic Speech Recognition Using Probabilistic Transcriptions in Swahili, Amharic, and Dinka Interspeech 2016 Broad Twitter Corpus: A Diverse Named Entity Recognition Resource COLING 2016 Best of Both Worlds: Human-Machine Collaboration for Object Annotation CVPR 2015