Online Feature Selection with Streaming Features

Citations Over TimeTop 1% of 2012 papers

Abstract

We propose a new online feature selection framework for applications with streaming features where the knowledge of the full feature space is unknown in advance. We define streaming features as features that flow in one by one over time whereas the number of training examples remains fixed. This is in contrast with traditional online learning methods that only deal with sequentially added observations, with little attention being paid to streaming features. The critical challenges for Online Streaming Feature Selection (OSFS) include 1) the continuous growth of feature volumes over time, 2) a large feature space, possibly of unknown or infinite size, and 3) the unavailability of the entire feature set before learning starts. In the paper, we present a novel Online Streaming Feature Selection method to select strongly relevant and nonredundant features on the fly. An efficient Fast-OSFS algorithm is proposed to improve feature selection performance. The proposed algorithms are evaluated extensively on high-dimensional datasets and also with a real-world case study on impact crater detection. Experimental results demonstrate that the algorithms achieve better compactness and higher prediction accuracy than existing streaming feature selection algorithms.

Related Papers

• → INCORPORATION OF RECOVERY AND REPAIR TIME IN THE RELIABILITY MODELLING OF FAULT-TOLERANT SYSTEM(1983)3 cited
• → An analytical approach to the unavailability estimation of protected connections in optical networks(2008)
• → Incorporation of Recovery and Repair Time in the Reliability Modelling of Fault-Tolerant System(1983)
• Processing mechanism for Web services unavailability based on reflective technology(2007)
• → Go in the Opposite Direction? The Impact of Unavailability on Crowdfunding Success(2020)