Multi-class l2-Boost with the scoring coding

作者：Ye, Lei^*; Wang, Can; Xu, Xin; Chen, Wei

来源：International Journal of Wavelets, Multiresolution and Information Processing, 2016, 14(6): 1650049.

DOI：10.1142/S0219691316500491

• Boosting
• multi-class
• scoring coding
• l(2)-loss
• global optimum

Boosting, one of the best off-the-shelf classification methods, has evoked widespread interest in machine learning and statistics. However, the original algorithm was developed for binary classification problems. In this paper, we study multi-class boosting algorithms under the l(2)-loss framework, and devise two multi-class l(2)-Boost algorithms. These are based on coordinate descent and gradient descent to minimize the multi-class l(2)-loss function. We derive a scoring coding scheme using optimal scoring constraints to encode class labels and a simple decoder to recover the true class labels. Our boosting algorithms are easily implemented and their results converge to the global optimum. Experiments with synthetic and real-world datasets show that, compared with several state-of-art methods, our algorithms provide more accurate results.

• 出版日期2016-11
• 单位中国人民解放军国防科学技术大学; 浙江大学