Crowdsourcing

Collaborative Multi-view Learning from Crowds UAI 2026 Finding the Signal in the Spam: Jointly Learning Rewards and Worker Reliability from Pairwise Comparisons UAI 2026 Task Assignment meets Annotator Modeling: Human-LLM Collaborative Annotation with Constraints ACL 2026 When and How Often is Weighted Majority Vote Optimal Under Log Loss? UAI 2026 Budget Allocation Exploiting Label Correlation between Instances UAI 2025 Scalable Spontaneous Speech Dataset (SSSD): Crowdsourcing Data Collection to Promote Dialogue Research Interspeech 2025 Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations EMNLP 2024 Label Consistency-based Worker Filtering for Crowdsourcing UAI 2024 Learning from Crowds with Dual-View K-Nearest Neighbor UAI 2024 The Empirical Variability of Narrative Perceptions of Social Media Texts EMNLP 2024 Black-Box Data Poisoning Attacks on Crowdsourcing IJCAI 2023 TDG4Crowd:Test Data Generation for Evaluation of Aggregation Algorithms in Crowdsourcing IJCAI 2023 Coreference Annotation of an Arabic Corpus using a Virtual World Game EMNLP 2022 CrowdPlay: Crowdsourcing Human Demonstrations for Offline Learning ICLR 2022 Crowdsourcing with Meta-Knowledge Transfer (Student Abstract) AAAI 2022 Crowdsourcing Beyond Annotation: Case Studies in Benchmark Data Collection EMNLP 2021 VocalTurk: Exploring Feasibility of Crowdsourced Speaker Identification Interspeech 2021 OptSLA: an Optimization-Based Approach for Sequential Label Aggregation EMNLP 2020 Max-MIG: an Information Theoretic Approach for Joint Learning from Crowds ICLR 2019 spark-crowd: A Spark Package for Learning from Crowdsourced Big Data JMLR 2019 Combining Human and Machine Transcriptions on the Zooniverse Platform EMNLP 2018 Distinguishing Question Subjectivity from Difficulty for Improved Crowdsourcing ACML 2018 Achieving budget-optimality with adaptive schemes in crowdsourcing NeurIPS 2016 Avoiding Imposters and Delinquents: Adversarial Crowdsourcing and Peer Prediction NeurIPS 2016 Eliciting Categorical Data for Optimal Aggregation NeurIPS 2016