Lambda and the Edge of Chaos in Recurrent Neural Networks

作者：Seifter Jared; Reggia James A^*

来源：Artificial Life, 2015, 21(1): 55-71.

DOI：10.1162/ARTL_a_00152

• Edge of chaos
• lambda
• emergence
• recurrent neural networks
• complex systems

The idea that there is an edge of chaos, a region in the space of dynamical systems having special meaning for complex living entities, has a long history in artificial life. The significance of this region was first emphasized in cellular automata models when a single simple measure, lambda(CA), identified it as a transitional region between order and chaos. Here we introduce a parameter lambda(NN) that is inspired by lambda(CA) but is defined for recurrent neural networks. We show through a series of systematic computational experiments that lambda(NN) generally orders the dynamical behaviors of randomly connected/weighted recurrent neural networks in the same way that lambda(CA) does for cellular automata. By extending this ordering to larger values of lambda(NN) than has typically been done with lambda(CA) and cellular automata, we find that a second edge-of-chaos region exists on the opposite side of the chaotic region. These basic results are found to hold under different assumptions about network connectivity, but vary substantially in their details. The results show that the basic concept underlying the lambda parameter can usefully be extended to other types of complex dynamical systems than just cellular automata.

• 出版日期2015