conftrace_

continual pretraining

63 papers

Explore in graph

Also known as

CP

Co-occurring keywords

large language model (13587) language model (4599) domain adaptation (4595) supervised fine-tuning (381) continual pre-training (85) transfer learning (5449) machine translation (2499) low-resource language (2273) instruction tuning (838) continual learning (1181)

Papers

BTS: Harmonizing Specialized Experts into a Generalist LLM EMNLP 2025
TartuNLP at WMT25 LLMs with Limited Resources for Slavic Languages Shared Task EMNLP 2025
TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining ACL 2025
Code-Switching Curriculum Learning for Multilingual Transfer in LLMs ACL 2025
InstructionCP: A Simple yet Effective Approach for Transferring Large Language Models to Target Languages ACL 2025
Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them EMNLP 2025
UTSK25 at WAT2025 Patent Claims Translation/Evaluation Task AACL 2025
HYPEROFA: Expanding LLM Vocabulary to New Languages via Hypernetwork-Based Embedding Initialization ACL 2025
Effective Long-Context Scaling of Foundation Models NAACL 2024
BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text NIPS 2024
A Practitioner's Guide to Real-World Continual Multimodal Pretraining NIPS 2024
AfriInstruct: Instruction Tuning of African Languages for Diverse Tasks EMNLP 2024
Gradient Localization Improves Lifelong Pretraining of Language Models EMNLP 2024
E2-LLM: Efficient and Extreme Length Extension of Large Language Models ACL 2024
Not All Tokens Are What You Need for Pretraining NIPS 2024
Sailor: Open Language Models for South-East Asia EMNLP 2024
Unlocking the Potential of Model Merging for Low-Resource Languages EMNLP 2024
Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise: A Case Study on Chinese Legal Domain ACL 2024
A Two-Stage Adaptation of Large Language Models for Text Ranking ACL 2024
Towards a Clean Text Corpus for Ottoman Turkish ACL 2024
PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment WACV 2024
Task Oriented In-Domain Data Augmentation EMNLP 2024
Prompt Discriminative Language Models for Domain Adaptation ACL 2023
Skill-it! A data-driven skills framework for understanding and training language models NIPS 2023
Learning Multi-Step Reasoning by Solving Arithmetic Tasks ACL 2023