Energy Optimization Induces Predictive-coding Properties in a Multicompartment Spiking Neural Network Model

Abstract

AbstractPredictive coding is a prominent theoretical framework for understanding the hierarchical sensory processing in the brain, yet how it could be implemented in networks of cortical neurons is still unclear. While most existing works have taken a hand-wiring approach to creating microcircuits that match experimental results, recent work in applying an optimisation approach to rate-based artificial neural networks revealed that cortical connectivity might result from self-organisation given some fundamental computational principle, such as energy efficiency. As no corresponding approach has studied this in more plausible networks of spiking neurons, we here investigate whether predictive coding properties in a multi-compartment spiking neural network can emerge from energy optimisation. We find that a model trained with an energy objective in addition to a task-relevant objective is able to reconstruct internal representations given top-down expectation signals alone. Additionally, neurons in the energy-optimised model also show differential responses to expected versus unexpected stimuli, qualitatively similar to experimental evidence for predictive coding. These findings indicate that predictive-coding-like behaviour might be an emergent property of energy optimisation, providing a new perspective on how predictive coding could be achieved in the cortex.