Fast Wavenet Generation Algorithm

Citations Over Time

Abstract

This paper presents an efficient implementation of the Wavenet generation process called Fast Wavenet. Compared to a naive implementation that has complexity O(2^L) (L denotes the number of layers in the network), our proposed approach removes redundant convolution operations by caching previous calculations, thereby reducing the complexity to O(L) time. Timing experiments show significant advantages of our fast implementation over a naive one. While this method is presented for Wavenet, the same scheme can be applied anytime one wants to perform autoregressive generation or online prediction using a model with dilated convolution layers. The code for our method is publicly available.

Related Papers

• → Auxiliary model based recursive and iterative least squares algorithm for autoregressive output error autoregressive systems(2015)5 cited
• Determining the Number of Regimes in a Threshold Autoregressive Model Using Smooth Transition Autoregressions(2005)
• → Implicit Stacked Autoregressive Model for Video Prediction(2023)6 cited
• → Non-Autoregressive vs Autoregressive Neural Networks for System Identification(2021)1 cited
• → Improved autoregressive model(2003)