Classification and Novel Class Detection in Concept-Drifting Data Streams under Time Constraints

Citations Over TimeTop 1% of 2010 papers

Abstract

Most existing data stream classification techniques ignore one important aspect of stream data: arrival of a novel class. We address this issue and propose a data stream classification technique that integrates a novel class detection mechanism into traditional classifiers, enabling automatic detection of novel classes before the true labels of the novel class instances arrive. Novel class detection problem becomes more challenging in the presence of concept-drift, when the underlying data distributions evolve in streams. In order to determine whether an instance belongs to a novel class, the classification model sometimes needs to wait for more test instances to discover similarities among those instances. A maximum allowable wait time T <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">c is imposed as a time constraint to classify a test instance. Furthermore, most existing stream classification approaches assume that the true label of a data point can be accessed immediately after the data point is classified. In reality, a time delay T <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">l is involved in obtaining the true label of a data point since manual labeling is time consuming. We show how to make fast and correct classification decisions under these constraints and apply them to real benchmark data. Comparison with state-of-the-art stream classification techniques prove the superiority of our approach.

Related Papers

• → Detecting group concept drift from multiple data streams(2022)65 cited
• → An Efficient Approach to Detect Concept Drifts in Data Streams(2017)10 cited
• → Towards Online Concept Drift Detection with Feature Selection for Data Stream Classification(2016)9 cited
• An Ensemble Classification Framework toEvolving Data Streams(2014)
• → A Review of Classification and Novel Class Detection Technique of Data Streams(2012)