Deep learning of support vector machines with class probability output networks

作者：Kim Sangwook; Yu Zhibin; Kil Rhee Man^*; Lee Minho

来源：Neural Networks, 2015, 64: 19-28.

DOI：10.1016/j.neunet.2014.09.007

• Deep learning
• Support vector machine
• Class probability output network
• Uncertainty measure

Deep learning methods endeavor to learn features automatically at multiple levels and allow systems to learn complex functions mapping from the input space to the output space for the given data. The ability to learn powerful features automatically is increasingly important as the volume of data and range of applications of machine learning methods continues to grow. This paper proposes a new deep architecture that uses support vector machines (SVMs) with class probability output networks (CPONs) to provide better generalization power for pattern classification problems. As a result, deep features are extracted without additional feature engineering steps, using multiple layers of the SVM classifiers with CPONs. The proposed structure closely approaches the ideal Bayes classifier as the number of layers increases. Using a simulation of classification problems, the effectiveness of the proposed method is demonstrated.

• 出版日期2015-4