Abstract
AbstractThe visual system of mammals is comprised of parallel, hierarchical specialized pathways. Different pathways are specialized in so far as they use representations that are more suitable for supporting specific downstream behaviours. In particular, the clearest example is the specialization of the ventral (“what”) and dorsal (“where”) pathways of the visual cortex. These two pathways support behaviours related to visual recognition and movement, respectively. To-date, deep neural networks have mostly been used as models of the ventral, recognition pathway. However, it is unknown whether both pathways can be modelled with a single deep ANN. Here, we ask whether a single model with a single loss function can capture the properties of both the ventral and the dorsal pathways. We explore this question using data from mice, who like other mammals, have specialized pathways that appear to support recognition and movement behaviours. We show that when we train a deep neural network architecture with two parallel pathways using a self-supervised predictive loss function, we can outperform other models in fitting mouse visual cortex. Moreover, we can model both the dorsal and ventral pathways. These results demonstrate that a self-supervised predictive learning approach applied to parallel pathway architectures can account for some of the functional specialization seen in mammalian visual systems.
Publisher
Cold Spring Harbor Laboratory
Reference64 articles.
1. Pouya Bashivan , Kohitij Kar , and James J DiCarlo . Neural population control via deep image synthesis. Science, 364(6439), 2019.
2. Anticipatory smooth eye movements and predictive pursuit after unilateral lesions in human brain;Experimental brain research,1996
3. A relationship between behavioral choice and the visual responses of neurons in macaque MT
4. The analysis of visual motion: a comparison of neuronal and psychophysical performance
5. Santiago A Cadena , Fabian H Sinz , Taliah Muhammad , Emmanouil Froudarakis , Erick Cobos , Edgar Y Walker , Jake Reimer , Matthias Bethge , Andreas Tolias , and Alexander S Ecker . How well do deep neural networks trained on object recognition characterize the mouse visual system? 2019.
Cited by
22 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献