Video data mining: semantic indexing and event detection from the association perspective

Citations Over TimeTop 10% of 2005 papers

Abstract

Advances in the media and entertainment industries, including streaming audio and digital TV, present new challenges for managing and accessing large audio-visual collections. Current content management systems support retrieval using low-level features, such as motion, color, and texture. However, low-level features often have little meaning for naive users, who much prefer to identify content using high-level semantics or concepts. This creates a gap between systems and their users that must be bridged for these systems to be used effectively. To this end, in this paper, we first present a knowledge-based video indexing and content management framework for domain specific videos (using basketball video as an example). We will provide a solution to explore video knowledge by mining associations from video data. The explicit definitions and evaluation measures (e.g., temporal support and confidence) for video associations are proposed by integrating the distinct feature of video data. Our approach uses video processing techniques to find visual and audio cues (e.g., court field, camera motion activities, and applause), introduces multilevel sequential association mining to explore associations among the audio and visual cues, classifies the associations by assigning each of them with a class label, and uses their appearances in the video to construct video indices. Our experimental results demonstrate the performance of the proposed approach.

Related Papers

• → Exploring the Semantic Gap for Movie Recommendations(2017)43 cited
• → Mining user hidden semantics from image content for image retrieval(2007)6 cited
• Method mapping image low-level features to high-level semantics(2004)
• → Image retrieval based on semantics of intra-region color properties(2008)2 cited
• → An Image Indexing and Retrieval Model Using Reasoning Services(2009)1 cited