Iterated Second-Order Label Sensitive Pooling for 3D Human Pose Estimation
Citations Over TimeTop 1% of 2014 papers
Abstract
Recently, the emergence of Kinect systems has demonstrated the benefits of predicting an intermediate body part labeling for 3D human pose estimation, in conjunction with RGB-D imagery. The availability of depth information plays a critical role, so an important question is whether a similar representation can be developed with sufficient robustness in order to estimate 3D pose from RGB images. This paper provides evidence for a positive answer, by leveraging (a) 2D human body part labeling in images, (b) second-order label-sensitive pooling over dynamically computed regions resulting from a hierarchical decomposition of the body, and (c) iterative structured-output modeling to contextualize the process based on 3D pose estimates. For robustness and generalization, we take advantage of a recent large-scale 3D human motion capture dataset, Human3.6M[18] that also has human body part labeling annotations available with images. We provide extensive experimental studies where alternative intermediate representations are compared and report a substantial 33% error reduction over competitive discriminative baselines that regress 3D human pose against global HOG features.
Related Papers
- Pooling in high-throughput drug screening.(2009)
- → A fully trainable network with RNN-based pooling(2019)22 cited
- Alpha-Pooling for Convolutional Neural Networks.(2018)
- → A Fully Trainable Network with RNN-based Pooling(2017)1 cited
- → Why and when should you pool? Analyzing Pooling in Recurrent\n Architectures(2020)