continual pre-training

Towards Geospatial Foundation Models via Continual Pretraining ICCV 2023 Traj-MAE: Masked Autoencoders for Trajectory Prediction ICCV 2023 A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition ACL 2022 AdaPrompt: Adaptive Model Training for Prompt-based NLP EMNLP 2022 CERT: Continual Pre-training on Sketches for Library-oriented Code Generation IJCAI 2022 ConfliBERT: A Pre-trained Language Model for Political Conflict and Violence NAACL 2022 Continual Pre-training of Language Models for Math Problem Understanding with Syntax-Aware Memory Network ACL 2022 Continuing Pre-trained Model with Multiple Training Strategies for Emotional Classification ACL 2022 Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning EMNLP 2022 Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysis AAAI 2022 Knowledge-Augmented Language Models for Cause-Effect Relation Classification ACL 2022 On the Robustness of Reading Comprehension Models to Entity Renaming NAACL 2022 Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency Gaps AACL 2022 ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning EMNLP 2021 Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning EMNLP 2021 Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting EMNLP 2021 Revisiting Pretraining with Adapters ACL 2021 ERNIE 2.0: A Continual Pre-Training Framework for Language Understanding AAAI 2020