Real-time Body Tracking Using a Gaussian Process Latent Variable Model
Citations Over TimeTop 10% of 2007 papers
Abstract
In this paper, we present a tracking framework for capturing articulated human motions in real-time, without the need for attaching markers onto the subject's body. This is achieved by first obtaining a low dimensional representation of the training motion data, using a nonlinear dimensionality reduction technique called back-constrained GPLVM. A prior dynamics model is then learnt from this low dimensional representation by partitioning the motion sequences into elementary movements using an unsupervised EM clustering algorithm. The temporal dependencies between these elementary movements are efficiently captured by a Variable Length Markov Model. The learnt dynamics model is used to bias the propagation of candidate pose feature vectors in the low dimensional space. By combining this with an efficient volumetric reconstruction algorithm, our framework can quickly evaluate each candidate pose against image evidence captured from multiple views. We present results that show our system can accurately track complex structured activities such as ballet dancing in real-time.
Related Papers
- → Latent Variable Models(2004)619 cited
- → Modeling Configural Patterns in Latent Variable Profiles: Association With an Endogenous Variable(2014)8 cited
- → Latent Variable Models(2016)4 cited
- Nonlinear Effects in the Generalized Latent Variable Model(2006)
- → A Multilevel Latent Variable Model for Multidimensional Longitudinal Data(2009)