FPGA-Based Low-Power Speech Recognition with Recurrent Neural Networks

Citations Over TimeTop 1% of 2016 papers

Abstract

In this paper, a neural network based real-time speech recognition (SR) system is developed using an FPGA for very low-power operation. The implemented system employs two recurrent neural networks (RNNs), one is a speech-tocharacter RNN for acoustic modeling (AM) and the other is for character-level language modeling (LM). The system also employs a statistical word-level LM to improve the recognition accuracy. The results of the AM, the character-level LM, and the word-level LM are combined using a fairly simple N-best search algorithm instead of the hidden Markov model (HMM) based network. The RNNs are implemented using massively parallel processing elements (PEs) for low latency and high throughput. The weights are quantized to 6 bits to store all of them in the on-chip memory of an FPGA. The proposed algorithm is implemented on a Xilinx XC7Z045, and the system can operate much faster than real-time.

Related Papers

• → Language Identification in Short Utterances Using Long Short-Term Memory (LSTM) Recurrent Neural Networks(2016)146 cited
• → Bidirectional recurrent neural network language models for automatic speech recognition(2015)83 cited
• → A new recurrent neural network architecture for pattern recognition(1996)8 cited
• → Comparative Analysis on variants of Neural Networks: An Experimental Study(2019)3 cited
• → Language Models with RNNs for Rescoring Hypotheses of Russian ASR(2016)3 cited