conftrace_

morphological alignment

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

subword tokenization (2) character-level segmentation (1) sanskrit word segmentation (1) technical lexicon (1) intrinsic evaluation (1) bpe tokenization (1) wordpiece tokenization (1) tokenizer inference (1) technical term translation (1) character-level transformer (1)

Papers

ReBPE: Iteratively Improving the Internal Structure of a Structured Tokeniser by Mining its Internal Structure EACL 2026 LEVOS: Leveraging Vocabulary Overlap with Sanskrit to Generate Technical Lexicons in Indian Languages ACL 2025 Greed is All You Need: An Evaluation of Tokenizer Inference Methods ACL 2024