conftrace_

multilingual pretraining

38 papers

Explore in graph

Co-occurring keywords

cross-lingual transfer (1477) low-resource language (2273) transfer learning (5449) neural machine translation (2310) machine translation (2499) language model (4599) multilingual model (925) multilingual pre-training (19) self-supervised learning (3777) pretrained language model (1030)

Papers

BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data EACL 2026
LangSAMP: Language-Script Aware Multilingual Pretraining ACL 2025
Scaling, Simplification, and Adaptation: Lessons from Pretraining on Machine-Translated Text EMNLP 2025
SenWiCh: Sense-Annotation of Low-Resource Languages for WiC using Hybrid Methods ACL 2025
Assessing the Role of Data Quality in Training Bilingual Language Models EMNLP 2025
NeighXLM: Enhancing Cross-Lingual Transfer in Low-Resource Languages via Neighbor-Augmented Contrastive Pretraining EMNLP 2025
Multilingual Pretraining for Pixel Language Models EMNLP 2025
Transformers: Leveraging OpenNMT and Transfer Learning for Low-Resource Indian Language Translation EMNLP 2025
Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models EMNLP 2025
Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly NAACL 2024
All Ears: Building Self-Supervised Learning based ASR models for Indian Languages at scale INTERSPEECH 2024
Investigating Cultural Alignment of Large Language Models ACL 2024
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception ACL 2024
Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning? COLING 2024
Measuring Cross-lingual Transfer in Bytes NAACL 2024
Meta Learning Text-to-Speech Synthesis in over 7000 Languages INTERSPEECH 2024
A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives EMNLP 2024
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning NIPS 2023
Multilingual Pre-training with Self-supervision from Global Co-occurrence Information ACL 2023
Fine-tuning mSLAM for the SIGMORPHON 2022 Shared Task on Grapheme-to-Phoneme Conversion ACL 2023
Fast and Efficient Multilingual Self-Supervised Pre-training for Low-Resource Speech Recognition INTERSPEECH 2023
Code-Switching with Word Senses for Pretraining in Neural Machine Translation EMNLP 2023
Mini But Mighty: Efficient Multilingual Pretraining with Linguistically-Informed Data Selection EACL 2023
Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation ACL 2022
Addressing Resource Scarcity across Sign Languages with Multilingual Pretraining and Unified-Vocabulary Datasets NIPS 2022