End-to-End Learning of Deformable Mixture of Parts and Deep Convolutional Neural Networks for Human Pose Estimation

Citations Over TimeTop 1% of 2016 papers

Abstract

Recently, Deep Convolutional Neural Networks (DCNNs) have been applied to the task of human pose estimation, and have shown its potential of learning better feature representations and capturing contextual relationships. However, it is difficult to incorporate domain prior knowledge such as geometric relationships among body parts into DCNNs. In addition, training DCNN-based body part detectors without consideration of global body joint consistency introduces ambiguities, which increases the complexity of training. In this paper, we propose a novel end-to-end framework for human pose estimation that combines DCNNs with the expressive deformable mixture of parts. We explicitly incorporate domain prior knowledge into the framework, which greatly regularizes the learning process and enables the flexibility of our framework for loopy models or tree-structured models. The effectiveness of jointly learning a DCNN with a deformable mixture of parts model is evaluated through intensive experiments on several widely used benchmarks. The proposed approach significantly improves the performance compared with state-of-the-art approaches, especially on benchmarks with challenging articulations.

Related Papers

• → Overview of deep learning in medical imaging(2017)1,052 cited
• → Deep learning ensemble 2D CNN approach towards the detection of lung cancer(2023)173 cited
• → 3D object pose estimation using stereo vision for object manipulation system(2017)21 cited
• → Leaf Features Extraction for Plant Classification using CNN(2021)7 cited
• → Deep Convolution Neural Network for RBC Images(2022)2 cited