POS Tagging for Improving Code-Switching Identification in Arabic

Citations Over TimeTop 10% of 2019 papers

Abstract

When speakers code-switch between their native language and a second language or language variant, they follow a syntactic pattern where words and phrases from the embedded language are inserted into the matrix language. This paper explores the possibility of utilizing this pattern in improving code-switching identification between Modern Standard Arabic (MSA) and Egyptian Arabic (EA). We try to answer the question of how strong is the POS signal in word-level code-switching identification. We build a deep learning model enriched with linguistic features (including POS tags) that outperforms the state-of-the-art results by 1.9% on the development set and 1.0% on the test set. We also show that in intrasentential code-switching, the selection of lexical items is constrained by POS categories, where function words tend to come more often from the dialectal language while the majority of content words come from the standard language.

Related Papers

• → Diglossic aphasia and the adaptation of the Bilingual Aphasia Test to Palestinian Arabic and Modern Standard Arabic(2018)8 cited
• → Normalization of Arabic Dialects into Modern Standard Arabic using BERT and GPT-2(2024)5 cited
• → The Attitude of Egyptian Arabic Speakers Towards Standard Arabic and Egyptian Arabic(2016)2 cited
• → ArabRecognizer: modern standard Arabic speech recognition inspired by DeepSpeech2 utilizing Franco-Arabic(2024)1 cited
• → Translating Proper Names in Up Disney Movie into Arabic: Modern Standard Arabic Versus Colloquial Egyptian Arabic ترجمة اسماء العلم فی فیلم دیزنی فوق : العربیة الفصحى مقابل العامیة المصریة(2022)