multilingual pretraining

BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data EACL 2026 Assessing the Role of Data Quality in Training Bilingual Language Models EMNLP 2025 Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models EMNLP 2025 LangSAMP: Language-Script Aware Multilingual Pretraining ACL 2025 Multilingual Pretraining for Pixel Language Models EMNLP 2025 NeighXLM: Enhancing Cross-Lingual Transfer in Low-Resource Languages via Neighbor-Augmented Contrastive Pretraining EMNLP 2025 Scaling, Simplification, and Adaptation: Lessons from Pretraining on Machine-Translated Text EMNLP 2025 Self-supervised learning of speech representations with Dutch archival data Interspeech 2025 Self-Supervised Models of Speech Processing for Haitian Creole Interspeech 2025 SenWiCh: Sense-Annotation of Low-Resource Languages for WiC using Hybrid Methods ACL 2025 Transformers: Leveraging OpenNMT and Transfer Learning for Low-Resource Indian Language Translation EMNLP 2025 A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives EMNLP 2024 All Ears: Building Self-Supervised Learning based ASR models for Indian Languages at scale Interspeech 2024 Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning? COLING 2024 Investigating Cultural Alignment of Large Language Models ACL 2024 Measuring Cross-lingual Transfer in Bytes NAACL 2024 Meta Learning Text-to-Speech Synthesis in over 7000 Languages Interspeech 2024 MTLS: Making Texts into Linguistic Symbols EMNLP 2024 Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly NAACL 2024 XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception ACL 2024 A Continual Pre-training Approach to Tele-Triaging Pregnant Women in Kenya AAAI 2023 Code-Switching with Word Senses for Pretraining in Neural Machine Translation EMNLP 2023 EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning NeurIPS 2023 Fast and Efficient Multilingual Self-Supervised Pre-training for Low-Resource Speech Recognition Interspeech 2023 Fine-tuning mSLAM for the SIGMORPHON 2022 Shared Task on Grapheme-to-Phoneme Conversion ACL 2023