Real-Time Gaze-Aware Cognitive Support System for Security Surveillance

Abstract

Security surveillance entails many cognitive challenges (e.g., task interruption, vigilance decrements, cognitive overload). To help surveillance operators overcome these difficulties and perform more efficient visual search, gaze-based intelligent systems can be developed. The present study aimed at testing the impact of the Scantracker system—which pinpointed neglected cameras while detecting and correcting attentional tunneling and vigilance decrease—on human scanning behavior and surveillance performance. Participants took part in a surveillance simulation, monitoring cameras and searching for ongoing incidents, and half of them was supported by the Scantracker. Although behavioral surveillance performance was not improved, participants supported by the Scantracker showed more efficient gaze-based measures of surveillance. Moreover, some of these measures were associated with performance, suggesting that scan pattern improvements might lead indirectly to more efficient incident detection. Overall, these results speak to the potential of using gaze- aware intelligent systems to support surveillance operators.