Visual–Tactile Fusion for Object Recognition
Citations Over TimeTop 1% of 2016 papers
Abstract
The camera provides rich visual information regarding objects and becomes one of the most mainstream sensors in the automation community. However, it is often difficult to be applicable when the objects are not visually distinguished. On the other hand, tactile sensors can be used to capture multiple object properties, such as textures, roughness, spatial features, compliance, and friction, and therefore provide another important modality for the perception. Nevertheless, effective combination of the visual and tactile modalities is still a challenging problem. In this paper, we develop a visual–tactile fusion framework for object recognition tasks. This paper uses the multivariate-time-series model to represent the tactile sequence and the covariance descriptor to characterize the image. Further, we design a joint group kernel sparse coding (JGKSC) method to tackle the intrinsically weak pairing problem in visual–tactile data samples. Finally, we develop a visual–tactile data set, composed of 18 household objects for validation. The experimental results show that considering both visual and tactile inputs is beneficial and the proposed method indeed provides an effective strategy for fusion.
Related Papers
- → Development of flexible tactile sensor for the envelop of curved robotic hand finger in grasping force sensing(2021)50 cited
- → Advanced Tactile Sensing for Robotics(1992)56 cited
- → A flexible fingertip tactile sensor(2010)9 cited
- Force approximation and tactile sensor prediction for reactive grasping(2012)
- → A sheet type tactile sensor using pressure conductive rubber with electrical-wires stitches method(2003)13 cited