Skip to content
conftrace_

continual pre-training

143 papers

CPT

Papers

ixi-GEN: Efficient Industrial sLLMs through Domain Adaptive Continual Pretraining EMNLP 2025 Language Confusion and Multilingual Performance: A Case Study of Thai-Adapted Large Language Models AACL 2025 Learning Dynamics in Continual Pre-Training for Large Language Models ICML 2025 LESA: Learnable LLM Layer Scaling-Up ACL 2025 LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation ACL 2025 MetaSynth: Meta-Prompting-Driven Agentic Scaffolds for Diverse Synthetic Data Generation ACL 2025 Mix-CPT: A Domain Adaptation Framework via Decoupling Knowledge Learning and Format Alignment ICLR 2025 Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study NAACL 2025 NTTSU at WMT2025 General Translation Task EMNLP 2025 NyayaAnumana and INLegalLlama: The Largest Indian Legal Judgment Prediction Dataset and Specialized Language Model for Enhanced Decision Analysis COLING 2025 Pipeline Analysis for Developing Instruct LLMs in Low-Resource Languages: A Case Study on Basque NAACL 2025 Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale ICML 2025 Quantifying Memorization in Continual Pre-training with Japanese General or Industry-Specific Corpora ACL 2025 Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge ACL 2025 Scaling Diffusion Language Models via Adaptation from Autoregressive Models ICLR 2025 SciLitLLM: How to Adapt LLMs for Scientific Literature Understanding ICLR 2025 Structure-aware Domain Knowledge Injection for Large Language Models ACL 2025 Sub-1B Language Models for Low-Resource Languages: Training Strategies and Insights for Basque EMNLP 2025 SYSTRAN @ WMT 2025 General Translation Task EMNLP 2025 TartuNLP at WMT25 LLMs with Limited Resources for Slavic Languages Shared Task EMNLP 2025 TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining ACL 2025 Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement ACL 2025 Towards Effective and Efficient Continual Pre-training of Large Language Models ACL 2025 ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025 UTSK25 at WAT2025 Patent Claims Translation/Evaluation Task AACL 2025