Teaching 3D geometry to deformable part models

Citations Over TimeTop 1% of 2012 papers

Abstract

Current object class recognition systems typically target 2D bounding box localization, encouraged by benchmark data sets, such as Pascal VOC. While this seems suitable for the detection of individual objects, higher-level applications such as 3D scene understanding or 3D object tracking would benefit from more fine-grained object hypotheses incorporating 3D geometric information, such as viewpoints or the locations of individual parts. In this paper, we help narrowing the representational gap between the ideal input of a scene understanding system and object class detector output, by designing a detector particularly tailored towards 3D geometric reasoning. In particular, we extend the successful discriminatively trained deformable part models to include both estimates of viewpoint and 3D parts that are consistent across viewpoints. We experimentally verify that adding 3D geometric information comes at minimal performance loss w.r.t. 2D bounding box localization, but outperforms prior work in 3D viewpoint estimation and ultra-wide baseline matching.

Related Papers

• → BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation(2015)1,062 cited
• → Automatic learning for object detection(2022)13 cited
• → BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation(2015)146 cited
• → Point Linking Network for Object Detection(2017)25 cited
• → OSAF_e: One-Stage Anchor Free Object Detection Method Considering Effective Area(2020)