The tongue and ear interface

Citations Over TimeTop 10% of 2014 papers

Abstract

We address the problem of performing silent speech recognition where vocalized audio is not available (e.g. due to a user's medical condition) or is highly noisy (e.g. during firefighting or combat). We describe our wearable system to capture tongue and jaw movements during silent speech. The system has two components: the Tongue Magnet Interface (TMI), which utilizes the 3-axis magnetometer aboard Google Glass to measure the movement of a small magnet glued to the user's tongue, and the Outer Ear Interface (OEI), which measures the deformation in the ear canal caused by jaw movements using proximity sensors embedded in a set of earmolds. We collected a data set of 1901 utterances of 11 distinct phrases silently mouthed by six able-bodied participants. Recognition relies on using hidden Markov model-based techniques to select one of the 11 phrases. We present encouraging results for user dependent recognition.

Related Papers

• → Development of HMM Based Automatic Speech Recognition System for Indian English(2018)3 cited
• → Speech Recognition System and Isolated Word Recognition based on Hidden Markov Model (HMM) for Hearing Impaired(2013)14 cited
• → Speaker adaptation method for HMM-based speech recognition(2003)17 cited
• → Stressed speech recognition using multi-dimensional hidden Markov models(2002)1 cited
• → Korean Voice Recognition System Development(2011)