Deep Sign: Hybrid CNN-HMM for Continuous Sign Language Recognition

Citations Over TimeTop 1% of 2016 papers

Abstract

This paper introduces the end-to-end embedding of a CNN into a HMM, while interpreting the outputs of the CNN in a Bayesian fashion. The hybrid CNN-HMM combines the strong discriminative abilities of CNNs with the sequence modelling capabilities of HMMs. Most current approaches in the field of gesture and sign language recognition disregard the necessity of dealing with sequence data both for training and evaluation. With our presented end-to-end embedding we are able to improve over the state-of-the-art on three challenging benchmark continuous sign language recognition tasks by between 15% and 38% relative and up to 13.3% absolute.

Related Papers

• → Development of HMM Based Automatic Speech Recognition System for Indian English(2018)3 cited
• → A mixed autoregressive hidden-markov-chain model applied to people's movements(2012)12 cited
• → Speech Recognition System and Isolated Word Recognition based on Hidden Markov Model (HMM) for Hearing Impaired(2013)14 cited
• → Text-dependent speaker identification using hidden Markov model with stress compensation technique(2002)11 cited
• → Stressed speech recognition using multi-dimensional hidden Markov models(2002)1 cited