Symmetry-aware Reinforcement Learning for Robotic Assembly under Partial Observability with a Soft Wrist

Citations Over TimeTop 10% of 2024 papers

Abstract

This study tackles the representative yet challenging contact-rich peg-in-hole task of robotic assembly, using a soft wrist that can operate more safely and tolerate lower-frequency control signals than a rigid one. Previous studies often use a fully observable formulation, requiring external setups or estimators for the peg-to-hole pose. In contrast, we use a partially observable formulation and deep reinforcement learning from demonstrations to learn a memory-based agent that acts purely on haptic and proprioceptive signals. Moreover, previous works do not incorporate potential domain symmetry and thus must search for solutions in a bigger space. Instead, we propose to leverage the symmetry for sample efficiency by augmenting the training data and constructing auxiliary losses to force the agent to adhere to the symmetry. Results in simulation with five different symmetric peg shapes show that our proposed agent can be comparable to or even outperform a state-based agent. In particular, the sample efficiency also allows us to learn directly on the real robot within 3 hours.

Related Papers

• → Observability methods and optimal meter placement(1990)78 cited
• → Switch observability for switched linear systems(2017)51 cited
• → Quantitative analysis of observability in linear time-varying systems(2016)10 cited
• → Observability of linear systems with multiple delays(1982)2 cited
• → On the observability and detectability of non-commensurate time-delay linear systems(2019)