Scalable Deep Unsupervised Clustering with Concrete GMVAEs
Citations Over Time
Abstract
Discrete random variables are natural components of probabilistic clustering models. A number of VAE variants with discrete latent variables have been developed. Training such methods requires marginalizing over the discrete latent variables, causing training time complexity to be linear in the number clusters. By applying a continuous relaxation to the discrete variables in these methods we can achieve a reduction in the training time complexity to be constant in the number of clusters used. We demonstrate that in practice for one such method, the Gaussian Mixture VAE, the use of a continuous relaxation has no negative effect on the quality of the clustering but provides a substantial reduction in training time, reducing training time on CIFAR-100 with 20 clusters from 47 hours to less than 6 hours.
Related Papers
- → Scalability Issues of Blockchain Technology(2020)30 cited
- → INVITED PAPER: Scalability and Performance Issues in Deeply Embedded Sensor Systems(2009)7 cited
- → On the scalability of multistage interconnection networks(2004)3 cited
- → Using Empirical Data for Scalability Analysis of Parallel Applications(2019)1 cited
- RESEARCH ON THE SCALABILITY OF THE LARGE SCALE PARALLEL APPLICATION PROGRAMS(2000)