conftrace_

continual pre-training

85 papers

Explore in graph

Also known as

CPT

Co-occurring keywords

large language model (13587) domain adaptation (4595) transfer learning (5449) supervised fine-tuning (381) continual pretraining (63) machine translation (2499) language model (4599) cross-lingual transfer (1477) pre-trained language model (1515) low-resource language (2273)

Papers

A Two-Stage Adaptation of Large Language Models for Text Ranking ACL 2024
Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale EMNLP 2024
Distill, Fuse, Pre-train: Towards Effective Event Causality Identification with Commonsense-Aware Pre-trained Model COLING 2024
Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning Analysis ACL 2024
Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data ACL 2024
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages ACL 2024
A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models EMNLP 2024
LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training EMNLP 2024
Task Oriented In-Domain Data Augmentation EMNLP 2024
Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language Models EMNLP 2024
Improving Referring Ability for Biomedical Language Models EMNLP 2024
Unlocking the Potential of Model Merging for Low-Resource Languages EMNLP 2024
Pre-training data selection for biomedical domain adaptation using journal impact metrics ACL 2024
ChatMusician: Understanding and Generating Music Intrinsically with LLM ACL 2024
LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages EMNLP 2024
IKUN for WMT24 General MT Task: LLMs Are Here for Multilingual Machine Translation EMNLP 2024
NTTSU at WMT2024 General Translation Task EMNLP 2024
Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation EMNLP 2024
Pre-training Differentially Private Models with Limited Public Data NIPS 2024
CamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective Models on French Biomedical Data COLING 2024
Recyclable Tuning for Continual Pre-training ACL 2023
Traj-MAE: Masked Autoencoders for Trajectory Prediction ICCV 2023
“Geen makkie”: Interpretable Classification and Simplification of Dutch Text Complexity ACL 2023
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training ACL 2023
A Continual Pre-training Approach to Tele-Triaging Pregnant Women in Kenya AAAI 2023