conftrace_

continued pretraining

48 papers

Explore in graph

Co-occurring keywords

large language model (13587) low-resource language (2273) domain adaptation (4595) multilingual model (925) instruction tuning (838) cross-lingual transfer (1477) transfer learning (5449) multilingual language model (444) continued pre-training (26) language adaptation (53)

Papers

Analyzing and Internalizing Complex Policy Documents for LLM Agents ACL 2026
TESS 2: A Large-Scale Generalist Diffusion Language Model ACL 2025
R-BPE: Improving BPE-Tokenizers with Token Reuse EMNLP 2025
Language Adaptation of Large Language Models: An Empirical Study on LLaMA2 COLING 2025
Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpus: A Case Study for Hindi LLMs COLING 2025
Continued Pretraining and Interpretability-Based Evaluation for Low-Resource Languages: A Galician Case Study ACL 2025
VRCP: Vocabulary Replacement Continued Pretraining for Efficient Multilingual Language Models COLING 2025
Leveraging High-Resource English Corpora for Cross-lingual Domain Adaptation in Low-Resource Japanese Medicine via Continued Pre-training EMNLP 2025
Reverse Modeling in Large Language Models NAACL 2025
Multilingual Language Model Pretraining using Machine-translated Data EMNLP 2025
Emergent Abilities of Large Language Models under Continued Pre-training for Language Adaptation ACL 2025
TartuNLP at WMT25 LLMs with Limited Resources for Slavic Languages Shared Task EMNLP 2025
From Unaligned to Aligned: Scaling Multilingual LLMs with Multi-Way Parallel Corpora EMNLP 2025
DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization ACL 2025
Don’t stop pretraining! Efficiently building specialised language models in resource-constrained settings. NAACL 2025
How to Train Long-Context Language Models (Effectively) ACL 2025
Exploring Design Choices for Building Language-Specific LLMs EMNLP 2024
Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokens EACL 2024
Exploring adaptation techniques of large speech foundation models for low-resource ASR: a case study on Northern Sámi INTERSPEECH 2024
A Continued Pretrained LLM Approach for Automatic Medical Note Generation NAACL 2024
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling NAACL 2024
Knowledge Acquisition through Continued Pretraining is Difficult: A Case Study on r/AskHistorians ACL 2024
Knowlab’s Submission to L+M Shared Task: All you need is continued pretraining of chemistry texts even for molecule captioning ACL 2024
wav2vec-S: Adapting Pre-trained Speech Models for Streaming ACL 2024
Jargon: A Suite of Language Models and Evaluation Tasks for French Specialized Domains COLING 2024