Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement
Citations Over TimeTop 22% of 2021 papers
Abstract
Unsupervised learning methods have recently shown their competitiveness against supervised training. Typically, these methods use a single objective to train the en-tire network. But one distinct advantage of unsupervised over supervised learning is that the former possesses more variety and freedom in designing the objective. In this work, we explore new dimensions of unsupervised learning by proposing the Progressive Stage-wise Learning (PSL) framework. For a given unsupervised task, we design multi-level tasks and define different learning stages for the deep network. Early learning stages are forced to focus on low-level tasks while late stages are guided to extract deeper information through harder tasks. We discover that by progressive stage-wise learning, unsupervised feature representation can be effectively enhanced. Our extensive experiments show that PSL consistently improves results for the leading unsupervised learning methods.
Related Papers
- → Semi-supervised learning: a brief review(2018)232 cited
- → Semi-supervised Learning(2020)30 cited
- → TWSVM for Unsupervised and Semi-supervised Learning(2016)4 cited
- → Controlled Competitive Learning: Extending Competitive Learning to Supervised Learning(2007)
- Supervised Competition Using Joined Growing Neural Gas(2014)