A new descriptor selection scheme for SVM in unbalanced class problem: a case study using skin sensitisation dataset

作者：Li S^*; Fedorowicz A; Andrew M E

来源：SAR and QSAR in Environmental Research, 2007, 18(5-6): 423-441.

DOI：10.1080/10629360701428474

• support vector machine
• variable selection
• unbalanced data
• Fisher's linear
• discriminant analysis
• skin sensitisation

A novel descriptor selection scheme for Support Vector Machine (SVM) classification method has been proposed and its utility demonstrated using a skin sensitisation dataset as an example. A backward elimination procedure, guided by mean accuracy (the average of specificity and sensitivity) of a leave-one-out cross validation, is devised for the SVM. Subsets of descriptors were first selected using a sequential t-test filter or a Random Forest filter, before backward elimination was applied. Different kernels for SVM were compared using this descriptor selection scheme. The Radial Basis RBF) kernel worked best when a sequential t-test filter was adopted. The highest mean accuracy, 84.9%, was obtained using SVM with 23 descriptors. The sensitivity and the specificity were as high as 93.1% and 76.6%, respectively. A linear kernel was found to be optimal when a Random Forest filter was used. The performance using 24 descriptors was comparable with a RBF kernel with a sequential t-test filter. As a comparison, Fisher's linear discriminant analysis (LDA) under the same descriptor selection scheme was carried out. SVM was shown to outperform the LDA.

• 出版日期2007