Assessing the brain representation of conscious and unconscious visual contents using encoding based representational similarity analysis

Abstract

AbstractThe development of novel frameworks to understand the properties of unconscious representations and how they differ from the conscious counterparts may be critical to make progress in the neuroscience of vision consciousness. Here we re-analysed data from a within-subject, high-precision, highly-sampled fMRI study (N=7) coupled with model-based representational similarity analysis (RSA) in order to provide an information-based approach to study the representation of conscious and unconscious visual contents The standard whole-brain searchlight RSA revealed that the hidden representations of convolutional neural network models explained brain activity patterns in response to unconscious contents in the ventral visual pathway in the majority of the observers, particularly for models that ranked high in explaining the variance of the visual cortex (i.e., VGGNet and ResNet50). Also five of seven subjects showed brain activity patterns that correlated with the model in frontoparietal areas in the unconscious trials. However, the results of an encoding-based RSA analyses in the unconscious condition were mixed and somehow difficult to interpret, including negative correlations between the representations of the computer vision models and the brain activity in frontal areas in a substantial amount of the observers.