uEFS: An efficient and comprehensive ensemble-based feature selection methodology to select informative features

Citations Over TimeTop 17% of 2018 papers

Abstract

Feature selection is considered to be one of the most critical methods for choosing appropriate features from a larger set of items. This task requires two basic steps: ranking and filtering. Of these, the former necessitates the ranking of all features, while the latter involves filtering out all irrelevant features based on some threshold value. In this regard, several feature selection methods with well-documented capabilities and limitations have already been proposed. Similarly, feature ranking is also nontrivial, as it requires the designation of an optimal cutoff value so as to properly select important features from a list of candidate features. However, the availability of a comprehensive feature ranking and a filtering approach, which alleviates the existing limitations and provides an efficient mechanism for achieving optimal results, is a major problem. Keeping in view these facts, we present an efficient and comprehensive univariate ensemble-based feature selection (uEFS) methodology to select informative features from an input dataset. For the uEFS methodology, we first propose a unified features scoring (UFS) algorithm to generate a final ranked list of features following a comprehensive evaluation of a feature set. For defining cutoff points to remove irrelevant features, we subsequently present a threshold value selection (TVS) algorithm to select a subset of features that are deemed important for the classifier construction. The uEFS methodology is evaluated using standard benchmark datasets. The extensive experimental results show that our proposed uEFS methodology provides competitive accuracy and achieved (1) on average around a 7% increase in f-measure, and (2) on average around a 5% increase in predictive accuracy as compared with state-of-the-art methods.

Related Papers

• → What is the ‘best’ method of forecasting?(1988)101 cited
• → Comparing multivariate and univariate subject-specific reference regions for blood constituents in healthy persons.(1982)19 cited
• The multi-item univariate delta check method: a new approach.(1998)
• → An algorithm for seeking the maximum value of univariate functions(1978)6 cited
• Theoretical Analysis of the Benchmark for Choosing Manipulative Instruments of Monetary Policies(2009)