conftrace_

crowd sourcing

23 papers

Explore in graph

Co-occurring keywords

crowd annotation (13) named entity recognition (2813) noisy label (321) active learning (1301) data quality (130) residual network (211) corpus annotation (182) crowd-sourced annotation (8) label aggregation (61) human computation (8)

Papers

Aggregating Crowd of LLMs for Cost-Effective Data Annotation EACL 2026
Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge ACL 2025
The Empirical Variability of Narrative Perceptions of Social Media Texts EMNLP 2024
When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Dataset ACL 2023
A Crowd-AI Collaborative Duo Relational Graph Learning Framework towards Social Impact Aware Photo Classification AAAI 2023
Dynamic Incentive Mechanism Design for COVID-19 Social Distancing AAAI 2022
InferES : A Natural Language Inference Corpus for Spanish Featuring Negation-Based Contrastive and Adversarial Examples COLING 2022
One for All: Simultaneous Metric and Preference Learning over Multiple Users NIPS 2022
UOR at SemEval-2021 Task 12: On Crowd Annotations; Learning with Disagreements to optimise crowd truth ACL 2021
Bike-Repositioning Using Volunteers: Crowd Sourcing with Choice Restriction AAAI 2021
FAST: Fast Annotation tool for SmarT devices EMNLP 2021
CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset EMNLP 2021
UOR at SemEval-2021 Task 12: On Crowd Annotations; Learning with Disagreements to optimise crowd truth SEMEVAL 2021
CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Dataset ACL 2020
Interactive Learning with Proactive Cognition Enhancement for Crowd Workers AAAI 2020
AlpacaTag: An Active Learning-based Crowd Annotation Framework for Sequence Tagging ACL 2019
Context Embedding Networks CVPR 2018
Statistical Quality Control for Human Computation and Crowdsourcing IJCAI 2018
The Many Benefits of Annotator Rationales for Relevance Judgments IJCAI 2017
Automatic Speech Recognition Using Probabilistic Transcriptions in Swahili, Amharic, and Dinka INTERSPEECH 2016
Broad Twitter Corpus: A Diverse Named Entity Recognition Resource COLING 2016
Best of Both Worlds: Human-Machine Collaboration for Object Annotation CVPR 2015
Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise NIPS 2009