A pruning algorithm with L (1/2) regularizer for extreme learning machine

作者:Fan, Ye-tian; Wu, Wei*; Yang, Wen-yu; Fan, Qin-wei; Wang, Jian
来源:Journal of Zhejiang University-Science C(Computers and Electronics), 2014, 15(2): 119-125.
DOI:10.1631/jzus.C1300197

摘要

Compared with traditional learning methods such as the back propagation (BP) method, extreme learning machine provides much faster learning speed and needs less human intervention, and thus has been widely used. In this paper we combine the L (1/2) regularization method with extreme learning machine to prune extreme learning machine. A variable learning coefficient is employed to prevent too large a learning increment. A numerical experiment demonstrates that a network pruned L (1/2) regularization has fewer hidden nodes but provides better performance than both the original network and the network pruned by L (2) regularization.