conftrace_

continual pre-training

85 papers

Explore in graph

Also known as

CPT

Co-occurring keywords

large language model (13587) domain adaptation (4595) transfer learning (5449) supervised fine-tuning (381) continual pretraining (63) machine translation (2499) language model (4599) cross-lingual transfer (1477) pre-trained language model (1515) low-resource language (2273)

Papers

Efficient Continual Pre-training of LLMs for Low-resource Languages NAACL 2025
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search NAACL 2025
Improving Continual Pre-training Through Seamless Data Packing ACL 2025
A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP IJCNLP 2025
EnerGIZAr: Leveraging GIZA++ for Effective Tokenizer Initialization ACL 2025
How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training ACL 2025
Language Confusion and Multilingual Performance: A Case Study of Thai-Adapted Large Language Models AACL 2025
Crypto-LLM: Two-Stage Language Model Pre-training with Ciphered and Natural Language Data IJCNLP 2025
Choose Your Words Wisely: Domain-adaptive Masking Makes Language Models Learn Faster NAACL 2025
Amuro & Char: Analyzing the Relationship between Pre-Training and Fine-Tuning of Large Language Models NAACL 2025
Effect of Multilingual and Domain-adapted Continual Pre-training on Few-shot Promptability ACL 2025
Quantifying Memorization in Continual Pre-training with Japanese General or Industry-Specific Corpora ACL 2025
Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code COLING 2025
Enhancing LLM Knowledge Learning through Generalization EMNLP 2025
Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models EMNLP 2025
LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation ACL 2025
ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025
Towards Effective and Efficient Continual Pre-training of Large Language Models ACL 2025
Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs EMNLP 2025
DACIP-RC: Domain Adaptive Continual Instruction Pre-Training via Reading Comprehension on Business Conversations EMNLP 2025
Context-aware and Style-related Incremental Decoding Framework for Discourse-Level Literary Translation EMNLP 2024
D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models NIPS 2024
A Novel Paradigm Boosting Translation Capabilities of Large Language Models NAACL 2024
Instruction Pre-Training: Language Models are Supervised Multitask Learners EMNLP 2024
Efficient Continual Pre-training for Building Domain Specific Large Language Models ACL 2024