Multi-Output Regularized Feature Projection

Citations Over TimeTop 12% of 2006 papers

Abstract

Dimensionality reduction by feature projection is widely used in pattern recognition, information retrieval, and statistics. When there are some outputs available (e.g., regression values or classification results), it is often beneficial to consider supervised projection, which is based not only on the inputs, but also on the target values. While this applies to a single-output setting, we are more interested in applications with multiple outputs, where several tasks need to be learned simultaneously. In this paper, we introduce a novel projection approach called Multi-Output Regularized feature Projection (MORP), which preserves the information of input features and, meanwhile, captures the correlations between inputs/outputs and (if applicable) between multiple outputs. This is done by introducing a latent variable model on the joint input-output space and minimizing the reconstruction errors for both inputs and outputs. It turns out that the mappings can be found by solving a generalized eigenvalue problem and are ready to extend to nonlinear mappings. Prediction accuracy can be greatly improved by using the new features since the structure of outputs is explored. We validate our approach in two applications. In the first setting, we predict users' preferences for a set of paintings. The second is concerned with image and text categorization where each image (or document) may belong to multiple categories. The proposed algorithm produces very encouraging results in both settings.

Related Papers

• → Facial expression recognition based on Haar-like feature detection(2008)26 cited
• → SIFT feature reduction based on feature similarity of repeated patterns(2013)1 cited
• → An automated feature-localisation algorithm for a feature-specific modular approach for face recognition(2007)2 cited
• An Application of Wavelet Transform in Feature Level Image Fusion and Object Classification(2004)