Realtime multibody visual SLAM with a smoothly moving monocular camera

Citations Over TimeTop 10% of 2011 papers

Abstract

This paper presents a realtime, incremental multibody visual SLAM system that allows choosing between full 3D reconstruction or simply tracking of the moving objects. Motion reconstruction of dynamic points or objects from a monocular camera is considered very hard due to well known problems of observability. We attempt to solve the problem with a Bearing only Tracking (BOT) and by integrating multiple cues to avoid observability issues. The BOT is accomplished through a particle filter, and by integrating multiple cues from the reconstruction pipeline. With the help of these cues, many real world scenarios which are considered unobservable with a monocular camera is solved to reasonable accuracy. This enables building of a unified dynamic 3D map of scenes involving multiple moving objects. Tracking and reconstruction is preceded by motion segmentation and detection which makes use of efficient geometric constraints to avoid difficult degenerate motions, where objects move in the epipolar plane. Results reported on multiple challenging real world image sequences verify the efficacy of the proposed framework.

Related Papers

• → Vision-Based SLAM: Stereo and Monocular Approaches(2007)251 cited
• → Improved Real-Time Monocular SLAM Using Semantic Segmentation on Selective Frames(2022)23 cited
• → Monocular SLAM for Visual Odometry: A Full Approach to the Delayed Inverse‐Depth Feature Initialization Method(2012)19 cited
• → Improved ORB-SLAM Based 3D Dense Reconstruction for Monocular Endoscopic Image(2020)5 cited
• → SLAM using Visual Scan-Matching with Distinguishable 3D Points(2006)15 cited