An iterative learning algorithm for feedforward neural networks with random weights

作者：Cao, Feilong; Wang, Dianhui^*; Zhu, Houying; Wang, Yuguang

来源：Information Sciences, 2016, 328: 546-557.

DOI：10.1016/j.ins.2015.09.002

• Neural networks with random weights
• Learning algorithm
• Stability
• Convergence

Feedforward neural networks with random weights (FNNRWs), as random basis function approximators, have received considerable attention due to their potential applications in dealing with large scale datasets. Special characteristics of such a learner model come from weights specification, that is, the input weights and biases are randomly assigned and the output weights can be analytically evaluated by a Moore-Penrose generalized inverse of the hidden output matrix. When the size of data samples becomes very large, such a learning scheme is infeasible for problem solving. This paper aims to develop an iterative solution for training FNNRWs with large scale datasets, where a regularization model is employed to potentially produce a learner model with improved generalization capability. Theoretical results on the convergence and stability of the proposed learning algorithm are established. Experiments on some UCI benchmark datasets and a face recognition dataset are carried out, and the results and comparisons indicate the applicability and effectiveness of our proposed learning algorithm for dealing with large scale datasets.

• 出版日期2016-1-20
• 单位中国计量大学; 流程工业综合自动化国家重点实验室; 东北大学