Probabilistic forward replay of anticipated stimulus sequences in human primary visual cortex and hippocampus

Abstract

AbstractThe ability to recognize and predict future spatiotemporal sequences is vital for perception. It has been proposed that the brain makes ‘intelligent guesses’ about future inputs by forward replaying these events. However, it is unknown whether and how this mechanism incorporates the probabilistic structure that is inherent to naturalistic environments. Here we tested forward replay in human V1 and hippocampus using a probabilistic cueing paradigm. Participants were exposed to two visual moving dot sequences (A and B) that shared the same starting point. Each stimulus sequence was paired with either a high or a low tone that predicted which sequence would follow with 80% cue validity (probabilistic context) or 50% cue validity (random context). We found that after exposure, the auditory cue together with the starting point triggered simultaneous forward replay of both the likely (A) and the less likely (B) stimulus sequence. Crucially, forward replay preserved the probabilistic relationship of the environment, such that the likely sequence was associated with greater anticipatory V1 activity compared to the less likely stimulus sequence. Analogous to V1, forward replay in hippocampus was also found to preserve the probabilistic cue-sequence relationship. Further, the anterior hippocampus was found to represent the predicted stimulus sequence, irrespective of the input, while the posterior hippocampus revealed a prediction error-like signal that was only observed when predictions were violated. These findings show how mnemonic and sensory areas coordinate predictive representations in probabilistic contexts to improve perceptual processing.