Importance of High-Order N-Gram Models in Morph-Based Speech Recognition

Citations Over TimeTop 10% of 2009 papers

Abstract

Speech recognition systems trained for morphologically rich languages face the problem of vocabulary growth caused by prefixes, suffixes, inflections, and compound words. Solutions proposed in the literature include increasing the size of the vocabulary and segmenting words into morphs. However, in many cases, the methods have only been experimented with low-order n-gram models or compared to word-based models that do not have very large vocabularies. In this paper, we study the importance of using high-order variable-length n-gram models when the language models are trained over morphs instead of whole words. Language models trained on a very large vocabulary are compared with models based on different morph segmentations. Speech recognition experiments are carried out on two highly inflecting and agglutinative languages, Finnish and Estonian. The results suggest that high-order models can be essential in morph-based speech recognition, even when lattices are generated for two-pass recognition. The analysis of recognition errors reveal that the high-order morph language models improve especially the recognition of previously unseen words.

Related Papers

• → The Word Order of Estonian: Implications to Universal Language(2006)17 cited
• → About the Current Status of Western-Based Prefixes Which are Used as Words in Turkish(2015)3 cited
• Морфологические особенности префиксов(2014)
• A Comparative study of the basic word order in modern Mongolian and Korean(2009)
• → Англи хэлний цагийн утга бүхий угтвар үгс, тэдгээрийг монгол хэлэнд орчуулах нь /at, in, on жишээн дээр/(2022)