subword tokenization

Why don’t people use character-level machine translation? ACL 2022 A Pilot Study for BERT Language Modelling and Morphological Analysis for Ancient and Medieval Greek EMNLP 2021 Ayuuk-Spanish Neural Machine Translator NAACL 2021 Decrypting Cryptic Crosswords: Semantically Complex Wordplay Puzzles as a Target for NLP NeurIPS 2021 Efficient Domain Adaptation of Language Models via Adaptive Tokenization EMNLP 2021 From characters to words: the turning point of BPE merges EACL 2021 IITP-MT at WAT2021: Indic-English Multilingual Neural Machine Translation using Romanized Vocabulary ACL 2021 Levenshtein Training for Word-level Quality Estimation EMNLP 2021 Low Resource Similar Language Neural Machine Translation for Tamil-Telugu EMNLP 2021 MiSS@WMT21: Contrastive Learning-reinforced Domain Adaptation in Neural Machine Translation EMNLP 2021 MVP-BERT: Multi-Vocab Pre-training for Chinese BERT ACL 2021 NITK-UoH: Tamil-Telugu Machine Translation Systems for the WMT21 Similar Language Translation Task EMNLP 2021 Should we find another model?: Improving Neural Machine Translation Performance with ONE-Piece Tokenization Method without Model Modification NAACL 2021 Subword Pooling Makes a Difference EACL 2021 T4T Solution: WMT21 Similar Language Task for the Spanish-Catalan and Spanish-Portuguese Language Pair EMNLP 2021 Wine is not v i n. On the Compatibility of Tokenizations across Languages EMNLP 2021 Byte Pair Encoding is Suboptimal for Language Model Pretraining EMNLP 2020 Combining Subword Representations into Word-level Representations in the Transformer Architecture ACL 2020 LIT Team’s System Description for Japanese-Chinese Machine Translation Task in IWSLT 2020 ACL 2020 Mind Your Inflections! Improving NLP for Non-Standard Englishes with Base-Inflection Encoding EMNLP 2020 Neural Machine Translation with Byte-Level Subwords AAAI 2020 NLPRL Odia-English: Indic Language Neural Machine Translation System AACL 2020 NUIG-Panlingua-KMI Hindi-Marathi MT Systems for Similar Language Translation Task @ WMT 2020 EMNLP 2020 Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking AAAI 2020 Towards Reasonably-Sized Character-Level Transformer NMT by Finetuning Subword Systems EMNLP 2020