0 citations
Progressive Neural Networks
arXiv (Cornell University)2016
Citations Over Time
Andrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, Raia Hadsell
Abstract
Learning to solve complex sequences of tasks--while both leveraging transfer and avoiding catastrophic forgetting--remains a key obstacle to achieving human-level intelligence. The progressive networks approach represents a step forward in this direction: they are immune to forgetting and can leverage prior knowledge via lateral connections to previously learned features. We evaluate this architecture extensively on a wide variety of reinforcement learning tasks (Atari and 3D maze games), and show that it outperforms common baselines based on pretraining and finetuning. Using a novel sensitivity measure, we demonstrate that transfer occurs at both low-level sensory and high-level control layers of the learned policy.
Related Papers
- → Ways of Forgetting: Israel and the Obliterated Memory of the Palestinian Nakba(2009)71 cited
- → Measurements of everyday memory: Toward the prevention of forgetting(1984)134 cited
- → Measures of Forgetting(2018)2 cited
- → Selective Forgetting of Deep Networks at a Finer Level than Samples(2020)2 cited
- → The Work of Forgetting(2021)