Can Scale-Consistent Monocular Depth Be Learned in a Self-Supervised Scale-Invariant Manner?

Citations Over TimeTop 10% of 2021 papers

Abstract

Geometric constraints are shown to enforce scale consistency and remedy the scale ambiguity issue in self-supervised monocular depth estimation. Meanwhile, scale-invariant losses focus on learning relative depth, leading to accurate relative depth prediction. To combine the best of both worlds, we learn scale-consistent self-supervised depth in a scale-invariant manner. Towards this goal, we present a scale-aware geometric (SAG) loss, which enforces scale consistency through point cloud alignment. Compared to prior arts, SAG loss takes relative scale into consideration during relative motion estimation, enabling more precise alignment and explicit supervision for scale inference. In addition, a novel two-stream architecture for depth estimation is designed, which disentangles scale from depth estimation and allows depth to be learned in a scale-invariant manner. The integration of SAG loss and two-stream network enables more consistent scale inference and more accurate relative depth estimation. Our method achieves state-of-the-art performance under both scale-invariant and scale-dependent evaluation settings.

Related Papers

• Depth estimation using monocular and stereo cues(2007)
• → Monocular 3D scene understanding with explicit occlusion reasoning(2011)77 cited
• → MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes(2022)14 cited
• → Monocular 3D vision for a robot assembly environment(2002)2 cited
• → Detecting Obstacle in 3D Space using Monocular Camera(2022)1 cited