Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text

Citations Over Time

Abstract

Recent work has described neural-network-based agents that are trained with reinforcement learning (RL) to execute language-like commands in simulated worlds, as a step towards an intelligent agent or robot that can be instructed by human users. However, the optimisation of multi-goal motor policies via deep RL from scratch requires many episodes of experience. Consequently, instruction-following with deep RL typically involves language generated from templates (by an environment simulator), which does not reflect the varied or ambiguous expressions of real users. Here, we propose a conceptually simple method for training instruction-following agents with deep RL that are robust to natural human instructions. By applying our method with a state-of-the-art pre-trained text-based language model (BERT), on tasks requiring agents to identify and position everyday objects relative to other objects in a naturalistic 3D simulated room, we demonstrate substantially-above-chance zero-shot transfer from synthetic template commands to natural instructions given by humans. Our approach is a general recipe for training any deep RL-based system to interface with human users, and bridges the gap between two research directions of notable recent success: agent-centric motor behavior and text-based representation learning.

Related Papers

• → Deep CNN models for pulmonary nodule classification: Model modification, model integration, and transfer learning(2019)60 cited
• → COVID-19 Recognition based on Deep Transfer Learning(2021)10 cited
• → Application of Deep Transfer Learning in Detection of Lung Cancer: A Systematic Survey(2023)10 cited
• → Comparison of Classification Models Based on Deep learning on COVID-19 Chest X-Rays(2022)3 cited
• → Face Mask Detection using Deep Learning and Transfer Learning Models(2022)2 cited