data collection

A Theory of Dynamic Benchmarks ICLR 2023 Incorporating Worker Perspectives into MTurk Annotation Practices for NLP EMNLP 2023 MyVoice: Arabic Speech Resource Collaboration Platform Interspeech 2023 Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation EMNLP 2023 Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resources EMNLP 2022 Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks ACL 2022 Learning From Failure: Data Capture in an Australian Aboriginal Community ACL 2022 Optimizing Data Collection for Machine Learning NeurIPS 2022 Safe Exploration for Efficient Policy Evaluation and Comparison ICML 2022 Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyond EMNLP 2022 Crowdsourcing Beyond Annotation: Case Studies in Benchmark Data Collection EMNLP 2021 C-Test Collector: A Proficiency Testing Application to Collect Training Data for C-Tests EACL 2021 Does Putting a Linguist in the Loop Improve NLU Data Collection? EMNLP 2021 Don’t Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data ACL 2021 EasyTurk: A User-Friendly Interface for High-Quality Linguistic Annotation with Amazon Mechanical Turk EACL 2021 Guideline Bias in Wizard-of-Oz Dialogues ACL 2021 Guiding Principles for Participatory Design-inspired Natural Language Processing ACL 2021 Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speech ACL 2021 MIN_PT: An European Portuguese Lexicon for Minorities Related Terms ACL 2021 VocalTurk: Exploring Feasibility of Crowdsourced Speaker Identification Interspeech 2021 What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks? ACL 2021 From ImageNet to Image Classification: Contextualizing Progress on Benchmarks ICML 2020 Heart Failure Education of African American and Hispanic/Latino Patients: Data Collection and Analysis ACL 2020 More Diverse Dialogue Datasets via Diversity-Informed Data Collection ACL 2020 New Protocols and Negative Results for Textual Entailment Data Collection EMNLP 2020