Skip to content
conftrace_

continued pretraining

73 papers

Papers

TartuNLP at WMT25 LLMs with Limited Resources for Slavic Languages Shared Task EMNLP 2025 Task-Adaptive Pretrained Language Models via Clustered-Importance Sampling ICLR 2025 TESS 2: A Large-Scale Generalist Diffusion Language Model ACL 2025 VRCP: Vocabulary Replacement Continued Pretraining for Efficient Multilingual Language Models COLING 2025 A Continued Pretrained LLM Approach for Automatic Medical Note Generation NAACL 2024 Adapting Large Language Models via Reading Comprehension ICLR 2024 Applications of BERT Models Towards Automation of Clinical Coding in Icelandic NAACL 2024 Building an Efficient Multilingual Non-Profit IR System for the Islamic Domain Leveraging Multiprocessing Design in Rust EMNLP 2024 Continued Pre-training on Sentence Analogies for Translation with Small Data COLING 2024 Development and Evaluation of Pre-trained Language Models for Historical Danish and Norwegian Literary Texts COLING 2024 Exploring adaptation techniques of large speech foundation models for low-resource ASR: a case study on Northern Sámi Interspeech 2024 Exploring Design Choices for Building Language-Specific LLMs EMNLP 2024 Exploring Very Low-Resource Translation with LLMs: The University of Edinburgh’s Submission to AmericasNLP 2024 Translation Task NAACL 2024 FLOR: On the Effectiveness of Language Adaptation COLING 2024 How Useful is Continued Pre-Training for Generative Unsupervised Domain Adaptation? ACL 2024 Improving Factuality in Clinical Abstractive Multi-Document Summarization by Guided Continued Pre-training NAACL 2024 Instruction-tuned Language Models are Better Knowledge Learners ACL 2024 IOL Research Machine Translation Systems for WMT24 General Machine Translation Shared Task EMNLP 2024 Jargon: A Suite of Language Models and Evaluation Tasks for French Specialized Domains COLING 2024 Knowlab’s Submission to L+M Shared Task: All you need is continued pretraining of chemistry texts even for molecule captioning ACL 2024 Knowledge Acquisition through Continued Pretraining is Difficult: A Case Study on r/AskHistorians ACL 2024 MELT: Materials-aware Continued Pre-training for Language Model Adaptation to Materials Science EMNLP 2024 Modular Adaptation of Multilingual Encoders to Written Swiss German Dialect EACL 2024 Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokens EACL 2024 [RETRACTED] Vikhr: Constructing a State-of-the-art Bilingual Open-Source Instruction-Following Large Language Model for Russian EMNLP 2024