conftrace_

subword tokenization

131 papers

Explore in graph

Co-occurring keywords

neural machine translation (2310) byte pair encoding (60) language model (4599) morphological analysis (343) byte-pair encoding (53) low-resource language (2273) machine translation (2499) large language model (13587) cross-lingual transfer (1477) named entity recognition (2813)

Papers

BERT is Not an Interlingua and the Bias of Tokenization EMNLP 2019
CUNI System for the Building Educational Applications 2019 Shared Task: Grammatical Error Correction ACL 2019
Investigating the Effectiveness of BPE: The Power of Shorter Sequences EMNLP 2019
Investigating the Effectiveness of BPE: The Power of Shorter Sequences IJCNLP 2019
Alibaba’s Neural Machine Translation Systems for WMT18 EMNLP 2018
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing EMNLP 2018