conftrace_

continual pre-training

85 papers

Explore in graph

Also known as

CPT

Co-occurring keywords

large language model (13587) domain adaptation (4595) transfer learning (5449) supervised fine-tuning (381) continual pretraining (63) machine translation (2499) language model (4599) cross-lingual transfer (1477) pre-trained language model (1515) low-resource language (2273)

Papers

Assessing the Belief Consistency of Large Language Models on the Logical Conversation Process ACL 2026
TELLME: Test-Enhanced Learning for Language Model Enrichment EACL 2026
MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings ACL 2026
How to Train a Real-World Silicon Concierge? Internalizing Complex Business Workflow to Only OneModel ACL 2026
Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training ACL 2026
KyrText: A Multi-Domain Large-Scale Corpus for Kyrgyz Language EACL 2026
Building a Turkish Large Language Model via Continual Pre-Training and Parameter-Efficient Adaptation EACL 2026
Can Continual Pretraining Bridge the Performance Gap between General-purpose and Specialized Language Models in the Medical Domain? ACL 2026
Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training ACL 2026
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan ACL 2026
LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points ACL 2026
Reinforcement Learning on Pre-Training Data ACL 2026
HanjaBridge: Resolving Semantic Ambiguity in Korean LLMs via Hanja-Augmented Pre-Training AAAI 2026
AMIYA Shared Task: Arabic Modeling In Your Accent at VarDial 2026 EACL 2026
Effect of Multilingual and Domain-adapted Continual Pre-training on Few-shot Promptability ACL 2025
Amuro & Char: Analyzing the Relationship between Pre-Training and Fine-Tuning of Large Language Models NAACL 2025
Structure-aware Domain Knowledge Injection for Large Language Models ACL 2025
Choose Your Words Wisely: Domain-adaptive Masking Makes Language Models Learn Faster NAACL 2025
A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP AACL 2025
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search NAACL 2025
EnerGIZAr: Leveraging GIZA++ for Effective Tokenizer Initialization ACL 2025
Crypto-LLM: Two-Stage Language Model Pre-training with Ciphered and Natural Language Data IJCNLP 2025
LESA: Learnable LLM Layer Scaling-Up ACL 2025
Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code COLING 2025
DACIP-RC: Domain Adaptive Continual Instruction Pre-Training via Reading Comprehension on Business Conversations EMNLP 2025