An information-geometrical approach to constructing kernel in support vector regression machines

作者:An WS*; Sun YG
来源:ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, SPRINGER-VERLAG BERLIN, HEIDELBERGER PLATZ 3, D-14197 BERLIN, GERMANY, 546-553, 2005.

摘要

The type of kernel function has a great important influence on the performance of support vector machines (SVMs); however, there is no theoretical guidance to choose a good kernel. To solve classification problem, Amari presented a method of modifying kernel based on information geometry theory. In the paper, we first review the classical formulation of regression problem, then propose an approach to constructing the kernel function in support vector regression machines from information-geometrical viewpoint, and point out its difference with the method that Amari used in support vector classification machines. Finally some simulation results show the effectiveness of the proposed method.