Skip to content
conftrace_

continual pre-training

143 papers

CPT

Papers

Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models COLING 2025 BTS: Harmonizing Specialized Experts into a Generalist LLM EMNLP 2025 Choose Your Words Wisely: Domain-adaptive Masking Makes Language Models Learn Faster NAACL 2025 Code-Switching Curriculum Learning for Multilingual Transfer in LLMs ACL 2025 CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search NAACL 2025 Crypto-LLM: Two-Stage Language Model Pre-training with Ciphered and Natural Language Data IJCNLP 2025 DACIP-RC: Domain Adaptive Continual Instruction Pre-Training via Reading Comprehension on Business Conversations EMNLP 2025 DACP: Domain-Adaptive Continual Pre-Training of Large Language Models for Phone Conversation Summarization EMNLP 2025 Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs EMNLP 2025 Demystifying Domain-adaptive Post-training for Financial LLMs EMNLP 2025 Domain Adaptation of Foundation LLMs for e-Commerce ACL 2025 Effect of Multilingual and Domain-adapted Continual Pre-training on Few-shot Promptability ACL 2025 Efficient ASR for Low-Resource Languages: Leveraging Cross-Lingual Unlabeled Data IJCNLP 2025 Efficient Continual Pre-training of LLMs for Low-resource Languages NAACL 2025 Efficient Domain Continual pretraining by Mitigating the Stability Gap ACL 2025 EnerGIZAr: Leveraging GIZA++ for Effective Tokenizer Initialization ACL 2025 Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them EMNLP 2025 Enhancing LLM Knowledge Learning through Generalization EMNLP 2025 From SALAMANDRA to SALAMANDRATA: BSC Submission for WMT25 General Machine Translation Shared Task EMNLP 2025 Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models EMNLP 2025 Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training NAACL 2025 How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training ACL 2025 HYPEROFA: Expanding LLM Vocabulary to New Languages via Hypernetwork-Based Embedding Initialization ACL 2025 Improving Continual Pre-training Through Seamless Data Packing ACL 2025 InstructionCP: A Simple yet Effective Approach for Transferring Large Language Models to Target Languages ACL 2025