byte pair encoding

AdaptBPE: From General Purpose to Specialized Tokenizers EACL 2026 AjamiMorph: Zero-Annotation Morphological Discovery for Hausa Ajami via Multi-Method Consensus EACL 2026 From Where Words Come: Efficient Regularization of Code Tokenizers Through Source Attribution ACL 2026 MUTANT: A Recipe for Multilingual Tokenizer Design ACL 2026 Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization ACL 2026 Peek2: Regex-free Byte-level Byte-Pair Encoding Pretokenizer for LLM Inference on Edge Devices ACL 2026 Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Models EACL 2026 Teaching Old Tokenizers New Words: Efficient Tokenizer Adaptation for Pretrained Models EACL 2026 TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar ACL 2026 Tokenization and Morphological Fidelity in Uralic NLP: A Cross-Lingual Evaluation EACL 2026 When Multilingual Evaluation Assumptions Fail: Tokenization Effects Across Scripts EACL 2026 A3-108 at BHASHA Task1: Asymmetric BPE configuration for Grammar Error Correction AACL 2025 A Preliminary Exploration of Phrase-Based SMT and Multi-BPE Segmentations through Concatenated Tokenised Corpora for Low-Resource Indian Languages EMNLP 2025 Byte Pair Encoding Is All You Need For Automatic Bengali Speech Recognition AACL 2025 ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling MLHC 2025 Egalitarian Language Representation in Language Models: It All Begins with Tokenizers COLING 2025 Enhancing Character-Level Understanding in LLMs through Token Internal Structure Learning ACL 2025 Exploring morphology-aware tokenization: A case study on Spanish language modeling EMNLP 2025 From Characters to Tokens: Dynamic Grouping with Hierarchical BPE EMNLP 2025 From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities ICLR 2025 Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers EMNLP 2025 Interpreting Topic Models in Byte-Pair Encoding Space COLING 2025 Jamo-Level Subword Tokenization in Low-Resource Korean Machine Translation NAACL 2025 Language Models over Canonical Byte-Pair Encodings ICML 2025 Linguistic Units as Tokens: Intrinsic and Extrinsic Evaluation with BabyLM EMNLP 2025