Scalable Recollections for Continual Lifelong Learning
Citations Over Time
Abstract
Given the recent success of Deep Learning applied to a variety of single tasks, it is natural to consider more human-realistic settings. Perhaps the most difficult of these settings is that of continual lifelong learning, where the model must learn online over a continuous stream of non-stationary data. A successful continual lifelong learning system must have three key capabilities: it must learn and adapt over time, it must not forget what it has learned, and it must be efficient in both training time and memory. Recent techniques have focused their efforts primarily on the first two capabilities while questions of efficiency remain largely unexplored. In this paper, we consider the problem of efficient and effective storage of experiences over very large time-frames. In particular we consider the case where typical experiences are O(n) bits and memories are limited to O(k) bits for k
Related Papers
- Towards more practical reinforcement learning(2015)
- → Towards Continual Knowledge Learning of Language Models(2021)40 cited
- → Continual World: A Robotic Benchmark For Continual Reinforcement Learning(2021)20 cited
- → Rational Learning: Finding a Balance Between Utility and Efficiency(1994)2 cited
- → Attritable multi-agent learning(2021)