Transsaccadic integration operates independently in different feature dimensions

Abstract

AbstractOur knowledge about objects in our environment reflects an integration of current visual input with information from preceding gaze fixations. Such a mechanism may reduce uncertainty, but requires the visual system to determine which information obtained in different fixations should be combined or kept separate. To investigate the basis of this decision, we conducted three experiments. Participants viewed a stimulus in their peripheral vision, then made a saccade that shifted the object into the opposite hemifield. During the saccade, the object underwent changes of varying magnitude in two feature dimensions (Experiment 1: color and location, Experiments 2 and 3: color and orientation). Participants reported whether they detected any change and estimated one of the post-saccadic features. Integration of pre-saccadic with post-saccadic input was observed as a bias in estimates towards the pre-saccadic feature value. In all experiments, pre-saccadic bias weakened as the magnitude of the transsaccadic change in the estimated feature increased. Changes in the other feature, despite having a similar probability of detection, had no effect on integration. Results were quantitatively captured by an observer model where the decision whether to integrate information from sequential fixations is made independently for each feature and coupled to awareness of a feature change.