language model initialization

1 papers

Explore in graph

Co-occurring keywords

tokenization (2) model pretraining (35) language model (4573) embedding initialization (10) vocabulary expansion (27)

Papers

An Empirical Comparison of Vocabulary Expansion and Initialization Approaches For Language Models CONLL 2024