Feature Selection Algorithm based on Random Forest applied to Sleep Apnea Detection

Citations Over TimeTop 13% of 2019 papers

Abstract

This paper presents a new feature selection method based on the changes in out-of-bag (OOB) Cohen kappa values of a random forest (RF) classifier, which was tested on the automatic detection of sleep apnea based on the oxygen saturation signal (SpO₂). The feature selection method is based on the RF predictor importance defined as the increase in error when features are permuted. This method is improved by changing the classification error into the Cohen kappa value, by adding an extra factor to avoid correlated features and by adapting the OOB sample selection to obtain a patient independent validation. When applying the method for sleep apnea classification, an optimal feature set of 3 parameters was selected out of 286. This was half of the 6 features that were obtained in our previous study. This feature reduction resulted in an improved interpretability of our model, but also a slight decrease in performance, without affecting the clinical screening performance. Feature selection is an important issue in machine learning and especially biomedical informatics. This new feature selection method introduces interesting improvements of RF feature selection methods, which can lead to a reduced feature set and an improved classifier interpretability.

Related Papers

• → The Influence of Feature Selection Methods on Accuracy, Stability and Interpretability of Molecular Signatures(2011)378 cited
• → Variable importance‐weighted Random Forests(2017)130 cited
• → An Optimized Random Forest Classifier for Diabetes Mellitus(2018)36 cited
• → Local Interpretability of Random Forests for Multi-Target Regression(2023)
• → Optimizing Heart Disease Classification: Exploring the Impact of Feature Selection and Performance of Machine Learning Algorithms(2023)