multilingual pretraining

Mini But Mighty: Efficient Multilingual Pretraining with Linguistically-Informed Data Selection EACL 2023 mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations EMNLP 2023 Multilingual Pre-training with Self-supervision from Global Co-occurrence Information ACL 2023 On-the-fly Cross-lingual Masking for Multilingual Pre-training ACL 2023 PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation EACL 2023 Soft Language Clustering for Multilingual Model Pre-training ACL 2023 Take a Closer Look at Multilinguality! Improve Multilingual Pre-Training Using Monolingual Corpora Only EMNLP 2023 TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets EMNLP 2023 UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining ICLR 2023 Addressing Resource Scarcity across Sign Languages with Multilingual Pretraining and Unified-Vocabulary Datasets NeurIPS 2022 Language Contamination Helps Explains the Cross-lingual Capabilities of English Pretrained Models EMNLP 2022 Lifting the Curse of Multilinguality by Pre-training Modular Transformers NAACL 2022 Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability ACL 2022 Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction ACL 2022 Multilingual unsupervised sequence segmentation transfers to extremely low-resource languages ACL 2022 PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining NAACL 2022 Towards Building ASR Systems for the Next Billion Users AAAI 2022 Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation ACL 2022 ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information ACL 2021 Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification EACL 2021 Discovering Representation Sprachbund For Multilingual Pre-Training EMNLP 2021 EdinSaar@WMT21: North-Germanic Low-Resource Multilingual NMT EMNLP 2021 End-to-End Cross-Lingual Spoken Language Understanding Model with Multilingual Pretraining Interspeech 2021 Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models NAACL 2021 Multilingual Pre-training with Universal Dependency Learning NeurIPS 2021