Sensory Input Matching Visual Working Memory Guides Internal Prioritization

Abstract

AbstractAdaptive behavior necessitates the prioritization of the most relevant information in the environment (external) and in memory (internal). Internal prioritization is known to guide the selection of external sensory input, but the reverse may also be possible: Does the environment guide the prioritization of memorized material? Here we addressed whether reappearing sensory input matching visual working memory (VWM) facilitates the prioritization of other non-reappearing memorized items. Participants (totaln= 72) memorized three orientations. Crucially some, but not all, items maintained in VWM were made available again in the environment. These reappearing items never had to be reproduced later. Experiment 1 showed that the reappearance of all but one memory item benefited accuracy and speed to the same extent as a spatial retro cue. This shows that reappearing memory-matching items allow for the dynamic prioritization of another non-reappearing memorized item. What aspects of the reappearing sensory input drive this effect? Experiment 2 demonstrated that prioritization was facilitated most if reappearing items matched VWM content in terms of both location and orientation. Sensory input fully matching VWM is likely processed more efficiently, possibly leading to stronger prioritization of other memory content. We showed the robustness of our findings in Experiment 3. We propose that the link between sensory processing and VWM is bidirectional: internal representations guide the processing of sensory input, which in turn facilitates the prioritization of other VWM content to subserve adaptive behavior.Public significance statementVisual attention allows for the selective processing of objects in our environment but also the prioritization of contents held in working memory. To date, most studies have investigated the prioritization of working memory content using static displays. However, in everyday life, objects appear, disappear and reappear from our visual field within a matter of seconds. Here we investigated whether participants could leverage the dynamic nature of the world to guide working memory prioritization. In three experiments we demonstrate that humans capitalize on reappearing objects to prioritize other, non-reappearing maintained objects. Moreover, we found that whenever reappearing objects matched memory fully, prioritization of other material was most effective. Our results provide insights into how working memory prioritization may occur in more natural settings.