Skip to content
conftrace_
2022 EMNLP EMNLP 2022

Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22)

Abstract

AbstractThis paper presents the results of the First WMT Shared Task on Sign Language Translation (WMT-SLT22).This shared task is concerned with automatic translation between signed and spoken languages. The task is novel in the sense that it requires processing visual information (such as video frames or human pose estimation) beyond the well-known paradigm of text-to-text machine translation (MT).The task featured two tracks, translating from Swiss German Sign Language (DSGS) to German and vice versa. Seven teams participated in this first edition of the task, all submitting to the DSGS-to-German track. Besides a system ranking and system papers describing state-of-the-art techniques, this shared task makes the following scientific contributions: novel corpora, reproducible baseline systems and new protocols and software for human evaluation. Finally, the task also resulted in the first publicly available set of system outputs and human evaluation scores for sign language translation.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Computer Vision and Natural Language Processing
🐣 Hot Topic Early Bird - video processing

Authors

Mathias Müller, Sarah Ebling, Eleftherios Avramidis, Alessia Battisti, Michèle Berger, Richard Bowden, Annelies Braffort, Necati Cihan Camgoz, Cristina España-Bonet, Roman Grundkiewicz, Zifan Jiang, Oscar Koller, Amit Moryossef, Regula Perrollaz, Sabine Reinhard, Annette Rios, Dimitar Shterionov, Sandra Sidler-Miserez, Katja Tissi

Topics

Artificial Intelligence > Core AI > Multimodal Learning Machine Learning > Learning Types > Self-Supervised Learning Computer Vision > Processing > Video Processing Natural Language Processing > Applications > Machine Translation Computer Vision > Core AI > Multimodal Learning Deep Learning > Learning Types > Multimodal Learning

Keywords

pose estimation machine translation multimodal learning sign language translation low-resource language video processing
Download PDF

More from EMNLP 2022

All EMNLP 2022 papers →
LUL’s WMT22 Automatic Post-Editing Shared Task Submission
Findings of the WMT 2022 Biomedical Translation Shared Task: Monolingual Clinical Case Reports
Findings of the WMT 2022 Shared Task on Chat Translation
Findings of the WMT’22 Shared Task on Large-Scale Machine Translation Evaluation for African Languages
Findings of the WMT 2022 Shared Tasks in Unsupervised MT and Very Low Resource Supervised MT
Overview and Results of MixMT Shared-Task at WMT 2022