subword tokenization

PROMT Systems for WMT23 Shared General Translation Task EMNLP 2023 Subword Segmental Machine Translation: Unifying Segmentation and Target Sentence Generation ACL 2023 The Helsinki-NLP Submissions at NADI 2023 Shared Task: Walking the Baseline EMNLP 2023 Tokenization and the Noiseless Channel ACL 2023 Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languages ACL 2023 Tokenization with Factorized Subword Encoding ACL 2023 To Split or Not to Split: Composing Compounds in Contextual Vector Spaces EMNLP 2023 TranSFormer: Slow-Fast Transformer for Machine Translation ACL 2023 What changes when you randomly choose BPE merge operations? Not much. EACL 2023 Words, Subwords, and Morphemes: What Really Matters in the Surprisal-Reading Time Relationship? EMNLP 2023 Addressing Segmentation Ambiguity in Neural Linguistic Steganography AACL 2022 A Vocabulary-Free Multilingual Neural Tokenizer for End-to-End Task Learning ACL 2022 Beyond Characters: Subword-level Morpheme Segmentation NAACL 2022 BPE beyond Word Boundary: How NOT to use Multi Word Expressions in Neural Machine Translation ACL 2022 Charformer: Fast Character Transformers via Gradient-based Subword Tokenization ICLR 2022 FiNER: Financial Numeric Entity Recognition for XBRL Tagging ACL 2022 KinyaBERT: a Morphology-aware Kinyarwanda Language Model ACL 2022 Linguistically Informed Post-processing for ASR Error correction in Sanskrit Interspeech 2022 MANTa: Efficient Gradient-Based Tokenization for End-to-End Robust Language Modeling EMNLP 2022 NLP DI at NADI Shared Task Subtask-1: Sub-word Level Convolutional Neural Models and Pre-trained Binary Classifiers for Dialect Identification EMNLP 2022 Richer Countries and Richer Representations ACL 2022 Searching for Optimal Subword Tokenization in Cross-domain NER IJCAI 2022 Subword-Delimited Downsampling for Better Character-Level Translation EMNLP 2022 The SIGMORPHON 2022 Shared Task on Morpheme Segmentation NAACL 2022 What do tokens know about their characters and how do they know it? NAACL 2022