Combining Global and Local Information for Knowledge-Assisted Image Analysis and Classification

Citations Over TimeTop 10% of 2007 papers

Abstract

A learning approach to knowledge-assisted image analysis and classification is proposed that combines global and local information with explicitly defined knowledge in the form of an ontology. The ontology specifies the domain of interest, its subdomains, the concepts related to each subdomain as well as contextual information. Support vector machines (SVMs) are employed in order to provide image classification to the ontology subdomains based on global image descriptions. In parallel, a segmentation algorithm is applied to segment the image into regions and SVMs are again employed, this time for performing an initial mapping between region low-level visual features and the concepts in the ontology. Then, a decision function, that receives as input the computed region-concept associations together with contextual information in the form of concept frequency of appearance, realizes image classification based on local information. A fusion mechanism subsequently combines the intermediate classification results, provided by the local- and global-level information processing, to decide on the final image classification. Once the image subdomain is selected, final region-concept association is performed using again SVMs and a genetic algorithm (GA) for optimizing the mapping between the image regions and the selected subdomain concepts taking into account contextual information in the form of spatial relations. Application of the proposed approach to images of the selected domain results in their classification (i.e., their assignment to one of the defined subdomains) and the generation of a fine granularity semantic representation of them (i.e., a segmentation map with semantic concepts attached to each segment). Experiments with images from the personal collection domain, as well as comparative evaluation with other approaches of the literature, demonstrate the performance of the proposed approach.

Related Papers

• → Classification using support vector machines with graded resolution(2005)31 cited
• → Smoothing Support Vector Machines for e-Insensitive Regressi(2006)2 cited
• On Multiclass Support Vector Machines: One-Against-Half Approach(2010)
• [발표논문] 인공신경망과 Support Vector Machine의 기업부도예측 성과 비교-Support Vector Machine의 유용성을 중심으로-(2004)
• → Context Ontology Modeling for Mobile Petrol Station Recommendation(2013)