conftrace_

continual pre-training

85 papers

Explore in graph

Also known as

CPT

Co-occurring keywords

large language model (13587) domain adaptation (4595) transfer learning (5449) supervised fine-tuning (381) continual pretraining (63) machine translation (2499) language model (4599) cross-lingual transfer (1477) pre-trained language model (1515) low-resource language (2273)

Papers

Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompts EMNLP 2023
Skill-it! A data-driven skills framework for understanding and training language models NIPS 2023
Continuing Pre-trained Model with Multiple Training Strategies for Emotional Classification ACL 2022
CERT: Continual Pre-training on Sketches for Library-oriented Code Generation IJCAI 2022
Continual Pre-training of Language Models for Math Problem Understanding with Syntax-Aware Memory Network ACL 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition ACL 2022
ConfliBERT: A Pre-trained Language Model for Political Conflict and Violence NAACL 2022
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning EMNLP 2022
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting EMNLP 2021
ERNIE 2.0: A Continual Pre-Training Framework for Language Understanding AAAI 2020