conftrace_

tokenizer adaptation

8 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) byte pair encoding (2) domain adaptation (2) vocabulary tuning (1) embedding relearning (1) cross-lingual vocabulary adaptation (1) vocabulary pruning (1) low-resource programming language (1) compression efficiency (1) tokenization efficiency (1)

Papers

AdaptBPE: From General Purpose to Specialized Tokenizers EACL 2026 Teaching Old Tokenizers New Words: Efficient Tokenizer Adaptation for Pretrained Models EACL 2026 Ted-Tok: Maintaining an Evolving Vocabulary for Lifelong Learning ACL 2026 Tokenizer-Aware Cross-Lingual Adaptation of Decoder-Only LLMs through Embedding Relearning and Swapping EACL 2026 Evaluating Tokenizer Adaptation Methods for Large Language Models on Low-Resource Programming Languages ACL 2025 An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference EMNLP 2024 [RETRACTED] Vikhr: Constructing a State-of-the-art Bilingual Open-Source Instruction-Following Large Language Model for Russian EMNLP 2024 Lite Training Strategies for Portuguese-English and English-Portuguese Translation EMNLP 2020