conftrace_

subword tokenization

131 papers

Explore in graph

Co-occurring keywords

neural machine translation (2310) byte pair encoding (60) language model (4599) morphological analysis (343) byte-pair encoding (53) low-resource language (2273) machine translation (2499) large language model (13587) cross-lingual transfer (1477) named entity recognition (2813)

Papers

GUIT-NLP’s Submission to Shared Task: Low Resource Indic Language Translation EMNLP 2023
Estimating Numbers without Regression EACL 2023
Incorporating Context into Subword Vocabularies EACL 2023
What changes when you randomly choose BPE merge operations? Not much. EACL 2023
Words, Subwords, and Morphemes: What Really Matters in the Surprisal-Reading Time Relationship? EMNLP 2023
FramingFreaks at SemEval-2023 Task 3: Detecting the Category and the Framing of Texts as Subword Units with Traditional Machine Learning SEMEVAL 2023
Local Byte Fusion for Neural Machine Translation ACL 2023
Byte-Level Grammatical Error Correction Using Synthetic and Curated Corpora ACL 2023
How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese ACL 2023
The SIGMORPHON 2022 Shared Task on Morpheme Segmentation NAACL 2022
What do tokens know about their characters and how do they know it? NAACL 2022
Beyond Characters: Subword-level Morpheme Segmentation NAACL 2022
MANTa: Efficient Gradient-Based Tokenization for End-to-End Robust Language Modeling EMNLP 2022
Addressing Segmentation Ambiguity in Neural Linguistic Steganography AACL 2022
NLP DI at NADI Shared Task Subtask-1: Sub-word Level Convolutional Neural Models and Pre-trained Binary Classifiers for Dialect Identification EMNLP 2022
Richer Countries and Richer Representations ACL 2022
Addressing Segmentation Ambiguity in Neural Linguistic Steganography IJCNLP 2022
FiNER: Financial Numeric Entity Recognition for XBRL Tagging ACL 2022
Why don’t people use character-level machine translation? ACL 2022
BPE beyond Word Boundary: How NOT to use Multi Word Expressions in Neural Machine Translation ACL 2022
Linguistically Informed Post-processing for ASR Error correction in Sanskrit INTERSPEECH 2022
Searching for Optimal Subword Tokenization in Cross-domain NER IJCAI 2022
Subword-Delimited Downsampling for Better Character-Level Translation EMNLP 2022
A Vocabulary-Free Multilingual Neural Tokenizer for End-to-End Task Learning ACL 2022
Wine is not v i n. On the Compatibility of Tokenizations across Languages EMNLP 2021