continued pretraining

A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAM𝛥 Integration into Upcycled MoE ACL 2026 AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages ACL 2026 Analyzing and Internalizing Complex Policy Documents for LLM Agents ACL 2026 Bidirectional LMs are Better Knowledge Memorizers? A Benchmark for Real-world Knowledge Injection ACL 2026 SciPedia: Unlocking the Value of Scientific Data for Pre-training ACL 2026 Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpus: A Case Study for Hindi LLMs COLING 2025 Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stages ICLR 2025 Continued Pretraining and Interpretability-Based Evaluation for Low-Resource Languages: A Galician Case Study ACL 2025 Don’t stop pretraining! Efficiently building specialised language models in resource-constrained settings. NAACL 2025 DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization ACL 2025 ELAINE-medLLM: Lightweight English Japanese Chinese Trilingual Large Language Model for Bio-medical Domain COLING 2025 Emergent Abilities of Large Language Models under Continued Pre-training for Language Adaptation ACL 2025 From Tower to Spire: Adding the Speech Modality to a Translation-Specialist LLM EMNLP 2025 From Unaligned to Aligned: Scaling Multilingual LLMs with Multi-Way Parallel Corpora EMNLP 2025 How to Train Long-Context Language Models (Effectively) ACL 2025 Language Adaptation of Large Language Models: An Empirical Study on LLaMA2 COLING 2025 Leveraging High-Resource English Corpora for Cross-lingual Domain Adaptation in Low-Resource Japanese Medicine via Continued Pre-training EMNLP 2025 MathCoder2: Better Math Reasoning from Continued Pretraining on Model-translated Mathematical Code ICLR 2025 Memorization vs. Reasoning: Updating LLMs with New Knowledge ACL 2025 Multilingual Language Model Pretraining using Machine-translated Data EMNLP 2025 R-BPE: Improving BPE-Tokenizers with Token Reuse EMNLP 2025 Reverse Modeling in Large Language Models NAACL 2025 Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching ACL 2025 Synthetic continued pretraining ICLR 2025 Tackling Low-Resource NMT with Instruction-Tuned LLaMA: A Study on Kokborok and Bodo EMNLP 2025