Abstract
We analyze the loss of information and the loss of learning capability inside an arrangement of neural networks. Our method is based on the formulation of the Bogoliubov transformations in order to connect the information between different points of the arrangement. Similar methods translated to the physics of black-holes, reproduce the Hawking radiation effect. From this perspective we can conclude that the black-holes are objects reproducing naturally the bottleneck effect, which is fundamental in neural networks in order to perceive the useful information, eliminating in this way the noise.
Subject
Physics and Astronomy (miscellaneous),General Mathematics,Chemistry (miscellaneous),Computer Science (miscellaneous)
Reference27 articles.
1. A logical calculus of the ideas immanent in nervous activity
2. The Organization of Behavior;Hebb,1949
3. Simulation of self-organizing systems by digital computer
4. Neural Networks and Deep Learning
http://neuralnetworksanddeeplearning.com/
5. Gradient Descent based Weight Learning for Grouping Problems: Application on Graph Coloring and Equitable Graph Coloring;Goudet;arXiv,2019