Improved Measures of Redundancy and Relevance for mRMR Feature Selection

Citations Over TimeTop 14% of 2019 papers

Abstract

Many biological or medical data have numerous features. Feature selection is one of the data preprocessing steps that can remove the noise from data as well as save the computing time when the dataset has several hundred thousand or more features. Another goal of feature selection is improving the classification accuracy in machine learning tasks. Minimum Redundancy Maximum Relevance (mRMR) is a well-known feature selection algorithm that selects features by calculating redundancy between features and relevance between features and class vector. mRMR adopts mutual information theory to measure redundancy and relevance. In this research, we propose a method to improve the performance of mRMR feature selection. We apply Pearson’s correlation coefficient as a measure of redundancy and R-value as a measure of relevance. To compare original mRMR and the proposed method, features were selected using both of two methods from various datasets, and then we performed a classification test. The classification accuracy was used as a measure of performance comparison. In many cases, the proposed method showed higher accuracy than original mRMR.

Related Papers

• Efficient Feature Selection via Analysis of Relevance and Redundancy(2004)
• → Road Accident Data Analysis: Data Preprocessing for Better Model Building(2019)17 cited
• → A stable feature selection method based on relevancy and redundancy(2021)4 cited
• → Hopfield Networks in Relevance and Redundancy Feature Selection Applied to Classification of Biomedical High-Resolution Micro-CT Images(2008)3 cited
• Feature Selection Based on Minimal Redundancy Principle for Text Classification(2007)