Skip to content
conftrace_

adaptive tokenization

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

subword tokenization (2) language model (2) non-latin script (1) video tokenization (1) perplexity optimization (1) language fairness (1) spatial evidence (1) tokenizer augmentation (1) variable token (1) large language model (1)

Papers

Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenization ICCV 2025 ElasticTok: Adaptive Tokenization for Image and Video ICLR 2025 Granularity-Adaptive Spatial Evidence Tokenization for Video Question Answering AAAI 2025 Enhancing Large Language Models through Adaptive Tokenizers NeurIPS 2024 MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization NeurIPS 2024 Efficient Domain Adaptation of Language Models via Adaptive Tokenization EMNLP 2021