subword segmentation

Probabilistic Bilingual Subword Segmentation with Latent Subword Alignment EACL 2026 A Preliminary Exploration of Phrase-Based SMT and Multi-BPE Segmentations through Concatenated Tokenised Corpora for Low-Resource Indian Languages EMNLP 2025 Exploring morphology-aware tokenization: A case study on Spanish language modeling EMNLP 2025 The Learning Dynamics of Subword Segmentation for Morphologically Diverse Languages IJCNLP 2025 Transformers: Leveraging OpenNMT and Transfer Learning for Low-Resource Indian Language Translation EMNLP 2025 A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation NAACL 2024 Impacts of Misspelled Queries on Translation and Product Search ACL 2024 Lexically Grounded Subword Segmentation EMNLP 2024 Subword Segmentation in LLMs: Looking at Inflection and Consistency EMNLP 2024 Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generation COLING 2024 Can Pretrained Language Models Derive Correct Semantics from Corrupt Subwords under Noise? ACL 2023 Effects of sub-word segmentation on performance of transformer language models EMNLP 2023 Enriching Wayúunaiki-Spanish Neural Machine Translation with Linguistic Information ACL 2023 Subword Segmental Machine Translation: Unifying Segmentation and Target Sentence Generation ACL 2023 BERTSeg: BERT Based Unsupervised Subword Segmentation for Neural Machine Translation AACL 2022 BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages ACL 2022 HFT: High Frequency Tokens for Low-Resource NMT COLING 2022 Revisiting Syllables in Language Modelling and Their Application on Low-Resource Machine Translation COLING 2022 Subword Segmental Language Modelling for Nguni Languages EMNLP 2022 Unsupervised Tokenization Learning EMNLP 2022 A Statistical Extension of Byte-Pair Encoding ACL 2021 How do different factors Impact the Inter-language Similarity? A Case Study on Indian languages ACL 2021 How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology? EMNLP 2021 Low Resource Similar Language Neural Machine Translation for Tamil-Telugu EMNLP 2021 Optimal Word Segmentation for Neural Machine Translation into Dravidian Languages ACL 2021