conftrace_

byte-level tokenization

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

subword tokenization (2) language model (2) low-resource language (2) neural machine translation (2) text correction (1) byte-level model (1) large language model (1) embedding compression (1) adaptive tokenization (1) tokenizer vulnerability (1)

Papers

EmByte: Decomposition and Compression Learning for Small yet Private NLP EMNLP 2025 Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers EMNLP 2025 MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization NeurIPS 2024 One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks EMNLP 2024 System Description of the NordicsAlps Submission to the AmericasNLP 2024 Machine Translation Shared Task NAACL 2024 A Benchmark and Dataset for Post-OCR text correction in Sanskrit EMNLP 2022 NLPRL Odia-English: Indic Language Neural Machine Translation System AACL 2020