continual pre-training

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training EMNLP 2024 LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages EMNLP 2024 Not All Tokens Are What You Need for Pretraining NeurIPS 2024 NTTSU at WMT2024 General Translation Task EMNLP 2024 Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation EMNLP 2024 PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment WACV 2024 Pre-training data selection for biomedical domain adaptation using journal impact metrics ACL 2024 Pre-training Differentially Private Models with Limited Public Data NeurIPS 2024 Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise: A Case Study on Chinese Legal Domain ACL 2024 Sailor: Open Language Models for South-East Asia EMNLP 2024 Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language Models EMNLP 2024 Task Oriented In-Domain Data Augmentation EMNLP 2024 Towards a Clean Text Corpus for Ottoman Turkish ACL 2024 Unlocking the Potential of Model Merging for Low-Resource Languages EMNLP 2024 A Continual Pre-training Approach to Tele-Triaging Pregnant Women in Kenya AAAI 2023 Continual Contrastive Finetuning Improves Low-Resource Relation Extraction ACL 2023 Continual Pre-training of Language Models ICLR 2023 “Geen makkie”: Interpretable Classification and Simplification of Dutch Text Complexity ACL 2023 Improving Knowledge Production Efficiency With Question Answering on Conversation ACL 2023 Learning Multi-Step Reasoning by Solving Arithmetic Tasks ACL 2023 Prompt Discriminative Language Models for Domain Adaptation ACL 2023 Recyclable Tuning for Continual Pre-training ACL 2023 Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training ACL 2023 Skill-it! A data-driven skills framework for understanding and training language models NeurIPS 2023 Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompts EMNLP 2023