2018
EMNLP
EMNLP 2018
Detecting Code-Switching between Turkish-English Language Pair
Abstract
AbstractCode-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6% micro-averaged F1-score on the introduced test data set.
🌉
Interdisciplinary Bridge
- Artificial Intelligence and Natural Language Processing
Authors
Topics
Machine Learning > Core Methods > Classification
Natural Language Processing > Understanding > Named Entity Recognition
Machine Learning > Learning Types > Supervised Learning
Deep Learning > Learning Types > Deep Learning
Machine Learning > Core Methods > Sequence Labeling
Artificial Intelligence > Core AI > Natural Language Processing