A Self-organizing Neural Network Using Fast Training and Pruning

作者：Qiao Jun fei^*; Li Miao; Han Hong gui

来源：International Joint Conference on Neural Networks, 2009-06-14 To 2009-06-19.

DOI：10.1109/ijcnn.2009.5178771

• Feed-forward neural network
• Pruning
• Subset-based training
• Fourier amplitude

A fast training and pruning algorithm is proposed for the feed-forward neural network (FNN) which consists of a fixed value subset-based training algorithm (FSBT) as well as a fast pruning algorithm (extended Fourier amplitude sensitivity test, EFAST) in this paper. The FNN is trained using FSBT, at each training iteration, only the weights of the independent nodes will be trained using the Levenberg-Marquardt (LM) algorithm, while keeping the weights of the dependent nodes unchanged. Meanwhile, the FNN is pruned using fast EFAST during training to remove redundant neurons in the hidden layer. In this way, the computational cost of the proposed EF-FNN will be reduced significantly. Experimental results suggest that the abilities of the final FNN are greatly improved. In the end, the proposed EF-FNN is used to predict the effluent water COD values; the results demonstrate the effectiveness of the proposed algorithm.

• 出版日期2009
• 单位北京工业大学