Active search signatures in a free‐viewing task exploiting concurrent EEG and eye movements recordings

Abstract

AbstractTasks we often perform in our everyday lives, such as reading or looking for a friend in the crowd, are seemingly straightforward but they actually require the orchestrated activity of several cognitive processes. Free‐viewing visual search requires a plan to move our gaze on the different items, identifying them, and deciding on whether to continue with the search. Little is known about the electrophysiological signatures of these processes in free‐viewing because there are technical challenges associated with eye movement artefacts. Here, we aimed to study how category information, as well as ecologically relevant variables such as the task performed, influence brain activity in a free‐viewing paradigm. Participants were asked to observe/search from an array of faces and objects embedded in random noise. We concurrently recorded electroencephalogram and eye movements and applied a deconvolution analysis approach to estimate the contribution of the different elements embedded in the task. Consistent with classical fixed‐gaze experiments and a handful of free‐viewing studies, we found a robust categorical effect around 150 ms in occipital and occipitotemporal electrodes. We also report a task effect, more negative in posterior central electrodes in visual search compared with exploration, starting at around 80 ms. We also found significant effects of trial progression and an interaction with the task effect. Overall, these results generalise the characterisation of early visual face processing to a wider range of experiments and show how a suitable analysis approach allows to discern among multiple neural contributions to the signal, preserving key attributes of real‐world tasks.