conftrace_

byte-level bpe

3 papers

Explore in graph

Also known as

BBPE

Co-occurring keywords · papers mentioning both

subword tokenization (2) low-resource language (2) out of vocabulary (1) sentencepiece tokenization (1) supervised translation (1) sequential transformer (1) low resource (1) byte-level tokenization (1) indic language (1) byte pair encoding (1)

Papers

Can Perplexity Predict Finetuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepali ACL 2025 NLPRL Odia-English: Indic Language Neural Machine Translation System AACL 2020 NLPRL System for Very Low Resource Supervised Machine Translation EMNLP 2020