conftrace_

continued pretraining

48 papers

Explore in graph

Co-occurring keywords

large language model (13587) low-resource language (2273) domain adaptation (4595) multilingual model (925) instruction tuning (838) cross-lingual transfer (1477) transfer learning (5449) multilingual language model (444) continued pre-training (26) language adaptation (53)

Papers

Applications of BERT Models Towards Automation of Clinical Coding in Icelandic NAACL 2024
Exploring Very Low-Resource Translation with LLMs: The University of Edinburgh’s Submission to AmericasNLP 2024 Translation Task NAACL 2024
Super donors and super recipients: Studying cross-lingual transfer between high-resource and low-resource languages ACL 2024
Instruction-tuned Language Models are Better Knowledge Learners ACL 2024
Building an Efficient Multilingual Non-Profit IR System for the Islamic Domain Leveraging Multiprocessing Design in Rust EMNLP 2024
SeaLLMs - Large Language Models for Southeast Asia ACL 2024
IOL Research Machine Translation Systems for WMT24 General Machine Translation Shared Task EMNLP 2024
SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain NIPS 2024
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models’ Memories ACL 2023
Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studies EMNLP 2023
Acoustic Word Embeddings for Untranscribed Target Languages with Continued Pretraining and Learned Pooling INTERSPEECH 2023
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification ACL 2023
KILM: Knowledge Injection into Encoder-Decoder Language Models ACL 2023
Difference-Masking: Choosing What to Mask in Continued Pretraining EMNLP 2023
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting ACL 2023
Continued Pretraining for Better Zero- and Few-Shot Promptability EMNLP 2022
Time Waits for No One! Analysis and Challenges of Temporal Misalignment NAACL 2022
How to Adapt Your Pretrained Multilingual Model to 1600 Languages ACL 2021
EntityBERT: Entity-centric Masking Strategy for Model Pretraining for the Clinical Domain NAACL 2021
Revisiting Pretraining with Adapters ACL 2021
How to Adapt Your Pretrained Multilingual Model to 1600 Languages IJCNLP 2021
Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media EMNLP 2021
Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation ACL 2021