Decorrelating Semantic Visual Attributes by Resisting the Urge to Share

Citations Over TimeTop 1% of 2014 papers

Abstract

Existing methods to learn visual attributes are prone to learning the wrong thing -- namely, properties that are correlated with the attribute of interest among training samples. Yet, many proposed applications of attributes rely on being able to learn the correct semantic concept corresponding to each attribute. We propose to resolve such confusions by jointly learning decorrelated, discriminative attribute models. Leveraging side information about semantic relatedness, we develop a multi-task learning approach that uses structured sparsity to encourage feature competition among unrelated attributes and feature sharing among related attributes. On three challenging datasets, we show that accounting for structure in the visual attribute space is key to learning attribute models that preserve semantics, yielding improved generalizability that helps in the recognition and discovery of unseen object categories.

Related Papers

• → Generalizing Generalizability in Information Systems Research(2003)1,544 cited
• → External Validity, Generalizability, and Knowledge Utilization(2004)251 cited
• → Applying Generalizability Theory using EduG(2011)108 cited
• → Reliability of observers' subjective impressions of families: A generalizability theory approach(2012)20 cited
• → Using Generalizability Theory for the Estimation of Reliability of a Patient Classification System(1994)1 cited