Brain Potentials after Clicking a Mouse: A New Psychophysiological Approach to Human-Computer Interaction

Abstract

As a first step in developing a new psychophysiological technique to assess mental workload in human-computer interaction (HCI), we recorded event-related brain potentials for visual stimuli triggered by voluntary mouse clicks. Twelve university students clicked a mouse button at their own pace. Each click triggered 1 of 3 alphabetic letters assigned to frequent standard, rare target, and rare nontarget stimuli. Counting target stimuli was required. Both rare stimuli elicited a P3 (P300) wave, the amplitude of which was larger when the stimuli were triggered by mouse clicks than when the same stimuli were presented automatically without mouse clicks. Postmotor potentials associated with clicking were small in amplitude (<2 GmV) and did not temporally overlap with the P3. The findings suggest that the P3 can be recorded for a computer's response to the user's intentional action and may be used as a measure of perceptual-central processing resources allocated to the HCI task. Actual or potential applications of this research include the evaluation of the user's attentional state during HCI by recording brain potentials in the “mouse click” or action-perception paradigm.