A novel hybrid system for feature selection based on an improved gravitational search algorithm and k-NN method

作者：Xiang Jie; Han XiaoHong^*; Duan Fu; Qiang Yan; Xiong XiaoYan; Lan Yuan; Chai Haishui

来源：Applied Soft Computing, 2015, 31: 293-307.

DOI：10.1016/j.asoc.2015.01.043

• Feature selection
• Binary classification
• Gravitational search algorithm
• k-nearest neighbor
• Leave-one-out cross validation
• Function optimizationa

Feature selection is an important pre-processing step for solving classification problems. This problem is often solved by applying evolutionary algorithms in order to decrease the dimensional number of features involved. In this paper, we propose a novel hybrid system to improve classification accuracy with an appropriate feature subset in binary problems based on an improved gravitational search algorithm. This algorithm makes the best of ergodicity of piecewise linear chaotic map to explore the global search and utilizes the sequential quadratic programming to accelerate the local search. We evaluate the proposed hybrid system on several UCI machine learning benchmark examples, comparing our approaches with feature selection techniques and obtained better predictions with consistently fewer relevant features. Furthermore, the improved gravitational search algorithm is tested on 23 nonlinear benchmark functions and compared with 5 other heuristic algorithms. The obtained results confirm the high performance of the improved gravitational search algorithm in solving function optimization problems.

• 出版日期2015-6
• 单位太原理工大学