Skip to content
conftrace_

continual pre-training

143 papers

CPT

Papers

AMIYA Shared Task: Arabic Modeling In Your Accent at VarDial 2026 EACL 2026 Assessing the Belief Consistency of Large Language Models on the Logical Conversation Process ACL 2026 Building a Turkish Large Language Model via Continual Pre-Training and Parameter-Efficient Adaptation EACL 2026 Can Continual Pretraining Bridge the Performance Gap between General-purpose and Specialized Language Models in the Medical Domain? ACL 2026 CHIPS: Efficient CLIP Adaptation via Curvature-aware Hybrid Influence-based Data Selection CVPR 2026 Continual Pretraining on Encrypted Synthetic Data for Privacy-Preserving LLMs EACL 2026 Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training ACL 2026 Efficient Low-Resource Language Adaptation via Multi-Source Dynamic Logit Fusion ACL 2026 ELO: Efficient Layer-Specific Optimization for Continual Pretraining of Multilingual LLMs EACL 2026 From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan ACL 2026 HanjaBridge: Resolving Semantic Ambiguity in Korean LLMs via Hanja-Augmented Pre-Training AAAI 2026 How to Train a Real-World Silicon Concierge? Internalizing Complex Business Workflow to Only OneModel ACL 2026 KyrText: A Multi-Domain Large-Scale Corpus for Kyrgyz Language EACL 2026 LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points ACL 2026 MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings ACL 2026 Nanda Family: Open-Weights Generative Large Language Models for Hindi EACL 2026 Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training ACL 2026 Reinforcement Learning on Pre-Training Data ACL 2026 StressRoBERTa: Cross-Condition Transfer Learning from Depression, Anxiety, and PTSD to Stress Detection EACL 2026 TELLME: Test-Enhanced Learning for Language Model Enrichment EACL 2026 Thesis Proposal: LLMs post-training for multilingual medical tasks. Instruction-Tuning, Continual-Pretraining or Reasoning? ACL 2026 A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP IJCNLP 2025 Amuro & Char: Analyzing the Relationship between Pre-Training and Fine-Tuning of Large Language Models NAACL 2025 Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code COLING 2025 Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Texts ACL 2025