End-to-End Speech Recognition: A Survey

Citations Over TimeTop 1% of 2023 papers

Abstract

In the last decade of automatic speech recognition (ASR) research, the introduction of deep learning has brought considerable reductions in word error rate of more than 50% relative, compared to modeling without deep learning. In the wake of this transition, a number of all-neural ASR architectures have been introduced. These so-called end-to-end (E2E) models provide highly integrated, completely neural ASR models, which rely strongly on general machine learning knowledge, learn more consistently from data, with lower dependence on ASR domain-specific experience. The success and enthusiastic adoption of deep learning, accompanied by more generic model architectures has led to E2E models now becoming the prominent ASR approach. The goal of this survey is to provide a taxonomy of E2E ASR models and corresponding improvements, and to discuss their properties and their relationship to classical hidden Markov model (HMM) based ASR architectures. All relevant aspects of E2E ASR are covered in this work: modeling, training, decoding, and external language model integration, discussions of performance and deployment opportunities, as well as an outlook into potential future developments.

Related Papers

• → A Spelling Correction Model for End-to-end Speech Recognition(2019)140 cited
• → HMM-GMM based Amazigh speech recognition system(2020)2 cited
• → Comparing computation in Gaussian mixture and neural network based large-vocabulary speech recognition(2013)2 cited
• → HMM-GMM based Amazigh speech recognition system(2020)1 cited
• → Text Independent Speaker Verficiation Using Dominant State Information of HMM-UBM(2015)