continual pre-training

Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training ACL 2025 Yandex Submission to the WMT25 General Machine Translation Task EMNLP 2025 AfriInstruct: Instruction Tuning of African Languages for Diverse Tasks EMNLP 2024 A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models EMNLP 2024 A Novel Paradigm Boosting Translation Capabilities of Large Language Models NAACL 2024 A Practitioner's Guide to Real-World Continual Multimodal Pretraining NeurIPS 2024 A Two-Stage Adaptation of Large Language Models for Text Ranking ACL 2024 BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text NeurIPS 2024 Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale EMNLP 2024 CamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective Models on French Biomedical Data COLING 2024 ChatMusician: Understanding and Generating Music Intrinsically with LLM ACL 2024 Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages ACL 2024 Context-aware and Style-related Incremental Decoding Framework for Discourse-Level Literary Translation EMNLP 2024 Data Engineering for Scaling Language Models to 128K Context ICML 2024 D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models NeurIPS 2024 Distill, Fuse, Pre-train: Towards Effective Event Causality Identification with Commonsense-Aware Pre-trained Model COLING 2024 E2-LLM: Efficient and Extreme Length Extension of Large Language Models ACL 2024 Effective Long-Context Scaling of Foundation Models NAACL 2024 Efficient Continual Pre-training for Building Domain Specific Large Language Models ACL 2024 Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data ACL 2024 Gradient Localization Improves Lifelong Pretraining of Language Models EMNLP 2024 IKUN for WMT24 General MT Task: LLMs Are Here for Multilingual Machine Translation EMNLP 2024 Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning Analysis ACL 2024 Improving Referring Ability for Biomedical Language Models EMNLP 2024 Instruction Pre-Training: Language Models are Supervised Multitask Learners EMNLP 2024