conftrace_

crowdsourced evaluation

9 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mean opinion score (2) emoji embedding (1) k-wise comparison (1) data cleansing (1) objective metrics (1) voice communication (1) audio-based evaluation (1) noisy speech dataset (1) validation study (1) bayesian rating aggregation (1)

Papers

Beyond Top Activations: Efficient and Reliable Crowdsourced Evaluation of Automated Interpretability CVPR 2026 Audio-Based Crowd-Sourced Evaluation of Machine Translation Quality EMNLP 2025 Crowdsourcing MUSHRA Tests in the Age of Generative Speech Technologies: A Comparative Analysis of Subjective and Objective Testing Methods Interspeech 2025 K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences CVPR 2025 Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems NAACL 2024 Interpreting Emoji with Emoji NAACL 2022 The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation EMNLP 2021 An Open Source Implementation of ITU-T Recommendation P.808 with Validation Interspeech 2020 A Scalable Noisy Speech Dataset and Online Subjective Test Framework Interspeech 2019