Linguistic Constraints on Statistical Word Segmentation: The Role of Consonants in Arabic and English

Citations Over TimeTop 16% of 2017 papers

Abstract

Statistical learning is often taken to lie at the heart of many cognitive tasks, including the acquisition of language. One particular task in which probabilistic models have achieved considerable success is the segmentation of speech into words. However, these models have mostly been tested against English data, and as a result little is known about how a statistical learning mechanism copes with input regularities that arise from the structural properties of different languages. This study focuses on statistical word segmentation in Arabic, a Semitic language in which words are built around consonantal roots. We hypothesize that segmentation in such languages is facilitated by tracking consonant distributions independently from intervening vowels. Previous studies have shown that human learners can track consonant probabilities across intervening vowels in artificial languages, but it is unknown to what extent this ability would be beneficial in the segmentation of natural language. We assessed the performance of a Bayesian segmentation model on English and Arabic, comparing consonant-only representations with full representations. In addition, we examined to what extent structurally different proto-lexicons reflect adult language. The results suggest that for a child learning a Semitic language, separating consonants from vowels is beneficial for segmentation. These findings indicate that probabilistic models require appropriate linguistic representations in order to effectively meet the challenges of language acquisition.

Related Papers

• Segmentation of Continuous Punjabi Speech Signal into Syllables(2010)
• Automatic Speech Segmentation with HMM(2002)
• → Using Hybrid HMM-Based Speech Segmentation to Improve Synthetic Speech Quality(2009)6 cited
• A comparison of different approaches to automatic speech segmentation(2002)
• A Study on the Segmentation of Speech Signal into Phonemic Units(1991)