Provable Bounds for Learning Some Deep Representations

Citations Over Time

Abstract

We give algorithms with provable guarantees that learn a class of deep nets in the generative model view popularized by Hinton and others. Our generative model is an $n$ node multilayer neural net that has degree at most $n^γ$ for some $γ<1$ and each edge has a random edge weight in $[-1,1]$. Our algorithm learns {\em almost all} networks in this class with polynomial running time. The sample complexity is quadratic or cubic depending upon the details of the model. The algorithm uses layerwise learning. It is based upon a novel idea of observing correlations among features and using these to infer the underlying edge structure via a global graph recovery procedure. The analysis of the algorithm reveals interesting structure of neural networks with random edge weights.

Related Papers

• → Overview of deep learning in medical imaging(2017)1,052 cited
• → Deep learning ensemble 2D CNN approach towards the detection of lung cancer(2023)173 cited
• → Exploring Deep Learning for View-Based 3D Model Retrieval(2020)109 cited
• → A Comprehensive Analysis of Machine Learning Techniques in Biomedical Image Processing Using Convolutional Neural Network(2022)18 cited
• → Survey of Machine Learning Applications of Convolutional Neural Networks to Medical Image Analysis(2021)2 cited