Co-occurring keywords · papers mentioning both
Papers
Aggregating Crowd of LLMs for Cost-Effective Data Annotation
EACL 2026
Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment
ACL 2026
An Adaptive Method for Weak Supervision with Drifting Data
AISTATS 2025
Bipartite Ranking From Multiple Labels: On Loss Versus Label Aggregation
ICML 2025
Efficient Data Labeling by Hierarchical Crowdsourcing with Large Language Models
COLING 2025
Label Aggregation for Composite Crowd Tasks by Worker Ability Constraint Satisfaction
AAAI 2025
Mixture of Experts Based Multi-Task Supervise Learning from Crowds
AAAI 2025
Predicting Median, Disagreement and Noise Label in Ordinal Word-in-Context Data
COLING 2025
Collaborative Refining for Learning from Inaccurate Labels
NeurIPS 2024
Corpus Considerations for Annotator Modeling and Scaling
NAACL 2024
FAIR: Filtering of Automatically Induced Rules
EACL 2024
The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels
NAACL 2024
Wisdom of Instruction-Tuned Language Model Crowds. Exploring Model Label Variation
COLING 2024
ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation
EMNLP 2023
Black-Box Data Poisoning Attacks on Crowdsourcing
IJCAI 2023
Leveraging Instance Features for Label Aggregation in Programmatic Weak Supervision
AISTATS 2023
Multilingual estimation of political-party positioning: From label aggregation to long-input Transformers
EMNLP 2023
Recovering Top-Two Answers and Confusion Probability in Multi-Choice Crowdsourcing
ICML 2023
SafeWebUH at SemEval-2023 Task 11: Learning Annotator Disagreement in Derogatory Text: Comparison of Direct Training vs Aggregation
SemEval 2023
SemEval-2023 Task 11: Learning with Disagreements (LeWiDi)
SemEval 2023
Testing conventional wisdom (of the crowd)
UAI 2023
You Are What You Annotate: Towards Better Models through Annotator Representations
EMNLP 2023
Adaptive Ranking-based Sample Selection for Weakly Supervised Class-imbalanced Text Classification
EMNLP 2022
Learning from Multiple Noisy Partial Labelers
AISTATS 2022
SPEAR : Semi-supervised Data Programming in Python
EMNLP 2022