Rate-Invariant Analysis of Trajectories on Riemannian Manifolds with Application in Visual Speech Recognition
Citations Over TimeTop 1% of 2014 papers
Abstract
In statistical analysis of video sequences for speech recognition, and more generally activity recognition, it is natural to treat temporal evolutions of features as trajectories on Riemannian manifolds. However, different evolution patterns result in arbitrary parameterizations of these trajectories. We investigate a recent framework from statistics literature that handles this nuisance variability using a cost function/distance for temporal registration and statistical summarization & modeling of trajectories. It is based on a mathematical representation of trajectories, termed transported square-root vector field (TSRVF), and the L2 norm on the space of TSRVFs. We apply this framework to the problem of speech recognition using both audio and visual components. In each case, we extract features, form trajectories on corresponding manifolds, and compute parametrization-invariant distances using TSRVFs for speech classification. On the OuluVS database the classification performance under metric increases significantly, by nearly 100% under both modalities and for all choices of features. We obtained speaker-dependent classification rate of 70% and 96% for visual and audio components, respectively.
Related Papers
- → Mining Sequential Update Summarization with Hierarchical Text Analysis(2016)6 cited
- → Text Summarization using topic modeling and cluster based MapReduce framework(2016)1 cited
- → Automatic Summarization of Chinese and English Parallel Documents(2003)4 cited
- Research of Automatic Summarization Methods(2011)
- Video Summarization Based on the "Entities-Description-Utilities" Model(2005)