Using Tactile Sensing to Improve the Sample Efficiency and Performance of Deep Deterministic Policy Gradients for Simulated In-Hand Manipulation Tasks

Citations Over TimeTop 10% of 2021 papers

Abstract

Deep Reinforcement Learning techniques demonstrate advances in the domain of robotics. One of the limiting factors is a large number of interaction samples usually required for training in simulated and real-world environments. In this work, we demonstrate for a set of simulated dexterous in-hand object manipulation tasks that tactile information can substantially increase sample efficiency for training (by up to more than threefold). We also observe an improvement in performance (up to 46%) after adding tactile information. To examine the role of tactile-sensor parameters in these improvements, we included experiments with varied sensor-measurement accuracy (ground truth continuous values, noisy continuous values, Boolean values), and varied spatial resolution of the tactile sensors (927 sensors, 92 sensors, and 16 pooled sensor areas in the hand). To facilitate further studies and comparisons, we make these touch-sensor extensions available as a part of the OpenAI Gym Shadow-Dexterous-Hand robotics environments.

Related Papers

• → A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Platform(2022)15 cited
• → Evaluation of manually created ground truth for multi-view people localization(2013)9 cited
• → Cost-Efficient Reinforcement Learning for Optimal Trade Execution on Dynamic Market Environment(2022)2 cited
• → Ground-Truth Data Modeling for Gait Analysis based on Kinect V2 Sensor Data(2022)
• → Classification without gradients: multi-agent reinforcement learning approach to optimization (Conference Presentation)(2023)