conftrace_

worker reliability

6 papers

Explore in graph

Co-occurring keywords

label aggregation (61) crowdsourcing systems (1) task assignment (17) majority voting (55) iterative learning (29) minimax optimal (90) consensus methods (3) control questions (1) quality control (27) streaming algorithm (131)

Papers

Recovering Top-Two Answers and Confusion Probability in Multi-Choice Crowdsourcing ICML 2023
OptSLA: an Optimization-Based Approach for Sequential Label Aggregation EMNLP 2020
A Dataset of Crowdsourced Word Sequences: Collections and Answer Aggregation for Ground Truth Creation EMNLP 2019
A Minimax Optimal Algorithm for Crowdsourcing NIPS 2017
Scoring Workers in Crowdsourcing: How Many Control Questions are Enough? NIPS 2013
Iterative Learning for Reliable Crowdsourcing Systems NIPS 2011