Uncertainty-Driven 6D Pose Estimation of Objects and Scenes from a Single RGB Image

Citations Over TimeTop 1% of 2016 papers

Abstract

In recent years, the task of estimating the 6D pose of object instances and complete scenes, i.e. camera localization, from a single input image has received considerable attention. Consumer RGB-D cameras have made this feasible, even for difficult, texture-less objects and scenes. In this work, we show that a single RGB image is sufficient to achieve visually convincing results. Our key concept is to model and exploit the uncertainty of the system at all stages of the processing pipeline. The uncertainty comes in the form of continuous distributions over 3D object coordinates and discrete distributions over object labels. We give three technical contributions. Firstly, we develop a regularized, auto-context regression framework which iteratively reduces uncertainty in object coordinate and object label predictions. Secondly, we introduce an efficient way to marginalize object coordinate distributions over depth. This is necessary to deal with missing depth information. Thirdly, we utilize the distributions over object labels to detect multiple objects simultaneously with a fixed budget of RANSAC hypotheses. We tested our system for object pose estimation and camera localization on commonly used data sets. We see a major improvement over competing systems.

Related Papers

• → Learning to Refine Human Pose Estimation(2018)112 cited
• → Fast 6D object pose estimation of shell parts for robotic assembly(2021)7 cited
• → SPGNet: Spatial Projection Guided 3D Human Pose Estimation in Low Dimensional Space(2022)3 cited
• → Fast 6D Object Pose Estimation of Shell Parts for Robotic Assembly(2021)1 cited
• → Residual Pose: A Decoupled Approach for Depth-based 3D Human Pose\n Estimation(2020)