Dissociable neural correlates of multisensory coherence and selective attention

Abstract

AbstractPrevious work has demonstrated that performance in an auditory selective attention task can be enhanced or impaired, depending on whether a task-irrelevant visual stimulus is temporally coherent with a target auditory stream or with a competing distractor. However, it remains unclear how audiovisual (AV) temporal coherence and auditory selective attention interact at the neurophysiological level. Here, we measured neural activity using electroencephalography (EEG) while participants performed an auditory selective attention task, detecting deviants in a target audio stream. The amplitude envelope of the two competing auditory streams changed independently, while the radius of a visual disc was manipulated to control the audiovisual coherence. Analysis of the neural responses to the sound envelope demonstrated that auditory responses were enhanced independently of the attentional condition: both target and masker stream responses were enhanced when temporally coherent with the visual stimulus. In contrast, attention enhanced the event-related response (ERP) evoked by the transient deviants, independently of AV coherence. Finally, we identified a spatiotemporal component of the ERP, likely originating from the superior temporal gyrus and the frontoparietal network, in which both attention and coherence synergistically modulated ERP amplitude. These results provide evidence for dissociable neural signatures of bottom-up (coherence) and top-down (attention) effects in the AV object formation.