A Large Margin Classifier with Additional Features

作者：Liu Xinwang^*; Yin Jianping; Zhu En; Zhang Guomin; Zhan Yubin; Li Miaomiao

来源：6th International Conference on Machine Learning and Data Mining in Pattern Recognition, 2009-07-23 to 2009-07-25.

• Large Margin Framework
• Incremental Missing Features Learning
• Support Vector Machine
• Kernel Method

We consider the problem of learning classifiers from samples which have additional features that are absent due to noise or corruption of measurement. The common approach for handling missing features in discriminative models is first to complete their unknown values, anti then a standard classification algorithm is employed over the completed data. In this paper, an algorithm which aims to maximize the margin of each sample in its own relevant subspace is proposed. We show how incomplete data can be classified directly without completing any missing features in a large-margin learning framework. Moreover, according to the theory of optimal kernel function, we proposed an optimal kernel function which is a convex composition of a set of linear kernel function to measure the similarity between additional features of each two samples. Based on the geometric interpretation of the margin, we formulate an objective function to maximize the margin of each sample in its own relevant subspace. In this formulation. we make use of the Structural parameters trained front existing features and optimize the structural parameters trained front additional features only. A two-step iterative procedure for solving, the objective function is proposed. By avoiding the pre-processing phase in which the data is completed, our algorithm Could offer considerable computational saving. We demonstrate our results on a number of standard benchmarks from UCI and the results Show that our algorithm can achieve better or comparable classification accuracy compared to the existing algorithms.

• 出版日期2009
• 单位中国人民解放军国防科学技术大学