Multiframe deep neural networks for acoustic modeling

Citations Over TimeTop 10% of 2013 papers

Abstract

Deep neural networks have been shown to perform very well as acoustic models for automatic speech recognition. Compared to Gaussian mixtures however, they tend to be very expensive computationally, making them challenging to use in real-time applications. One key advantage of such neural networks is their ability to learn from very long observation windows going up to 400 ms. Given this very long temporal context, it is tempting to wonder whether one can run neural networks at a lower frame rate than the typical 10 ms, and whether there might be computational benefits to doing so. This paper describes a method of tying the neural network parameters over time which achieves comparable performance to the typical frame-synchronous model, while achieving up to a 4X reduction in the computational cost of the neural network activations.

Related Papers

• → Deep learning: Evolution and expansion(2018)158 cited
• → Multi-Condition Training on Deep Convolutional Neural Networks for Robust Plant Diseases Detection(2019)16 cited
• → Higher frame rates for television(2013)1 cited
• → Adversarial Robustness of Deep Learning: Theory, Algorithms, and Applications(2021)3 cited
• → Interpretable Mesomorphic Networks for Tabular Data(2023)1 cited