An associative sparse coding neural network and applications

作者：Zeng Xianhua^*; Luo Siwei; Li Qingyong

来源：Neurocomputing, 2010, 73(4-6): 684-689.

DOI：10.1016/j.neucom.2008.11.033

• Neural network
• Nonlinearity
• Receptive field
• Sparse coding
• Recognition

Some linear sparse coding models have been proposed for modeling responses in the early stage of the visual system, but nonlinear operations are ubiquitous in visual cortex. So we put forward an associative sparse coding neural network (ASCNN) with nonlinear response property in top-layer coding units. In our ASCNN model, the choices of sparseness function must correspond to the characters of activation function. This paper gives several reasonable and efficient methods for constructing sparseness functions and activation functions. Experiment on benchmark natural image dataset shows that our model can successfully simulate receptive field and nonlinear sparse response property of simple cells. Moreover, in two recognition tasks on face images and handwritten digits, experimental results show that our model works much better than linear sparse coding model (Sparsenet) by combining with linear neural network classifier.

• 出版日期2010-1
• 单位重庆邮电大学; 北京交通大学