Routes to Chaos in Neural Networks with Random Weights

Abstract

Neural networks are dense in the space of dynamical system. We present a Monte Carlo study of the dynamic properties along the route to chaos over random dynamical system function space by randomly sampling the neural network function space. Our results show that as the dimension of the system (the number of dynamical variables) is increased, the probability of chaos approaches unity. We present theoretical and numerical results which show that as the dimension is increased, the quasiperiodic route to chaos is the dominant route. We also qualitatively analyze the dynamics along the route.