A Deep Hierarchical Approach to Lifelong Learning in Minecraft
Citations Over TimeTop 10% of 2017 papers
Abstract
We propose a lifelong learning system that has the ability to reuse and transfer knowledge from one task to another while efficiently retaining the previously learned knowledge-base. Knowledge is transferred by learning reusable skills to solve tasks in Minecraft, a popular video game which is an unsolved and high-dimensional lifelong learning problem. These reusable skills, which we refer to as Deep Skill Networks, are then incorporated into our novel Hierarchical Deep Reinforcement Learning Network (H-DRLN) architecture using two techniques: (1) a deep skill array and (2) skill distillation, our novel variation of policy distillation (Rusu et. al. 2015) for learning skills. Skill distillation enables the H-DRLN to efficiently retain knowledge and therefore scale in lifelong learning, by accumulating knowledge and encapsulating multiple reusable skills into a single distilled network. The H-DRLN exhibits superior performance and lower learning sample complexity compared to the regular Deep Q Network (Mnih et. al. 2015) in sub-domains of Minecraft.
Related Papers
- → Lifelong Learning in Higher Education(2021)202 cited
- → The determinants and labour market effects of lifelong learning(2003)179 cited
- Evolution and qualitative change: from lifelong education to lifelong learning(2003)
- Lifelong Learning Policies and Practices in UK since 1997(2008)
- Policies for Lifelong Education,Lifelong Learning and learning society:A Survey(2009)