conftrace_

annotation quality

109 papers

Explore in graph

Co-occurring keywords

inter-annotator agreement (134) human evaluation (379) large language model (13587) named entity recognition (2813) text classification (6793) data quality (130) data annotation (101) text annotation (151) natural language processing (2034) active learning (1301)

Papers

A Probabilistic Annotation Model for Crowdsourcing Coreference EMNLP 2018
Effective Crowdsourcing for a New Type of Summarization Task NAACL 2018
YEDDA: A Lightweight Collaborative Text Span Annotation Tool ACL 2018
Rethinking the Agreement in Human Evaluation Tasks COLING 2018
Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection ACL 2017
Sequence Effects in Crowdsourced Annotations EMNLP 2017
Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation ACL 2017
Crowdsourcing Complex Language Resources: Playing to Annotate Dependency Syntax COLING 2016
Building a Bird Recognition App and Large Scale Dataset With Citizen Scientists: The Fine Print in Fine-Grained Dataset Collection CVPR 2015