An Integrated Application of Motion Sensing and Eye Movement Tracking Techniques in Perceiving User Behaviors in a Large Display Interaction

Abstract

In public use of a large display, it is a usual phenomenon that multiple users individually participate in respective tasks on a common device. Previous studies have categorized such activity as independent interaction that involves little group engagement. However, by investigating how users approach, participate in, and interact with large displays, we found that parallel use is affected by group factors such as group size and between-user relationship. To gain a thorough understanding of individual and group behaviors, as well as parallel interaction task performance, one 70-inch display-based information searching task and experiment was conducted, in which a mobile eye movement tracking headset and a motion sensing RGB-depth sensor were simultaneously applied. The results showed that (1) a larger group size had a negative influence on the group users’ concentration on the task, perceived usability, and user experience; (2) a close relationship between users contributed to occasional collaborations, which was found to improve the users’ task completion time efficiency and their satisfaction on the large display user experience. This study proves that an integrated application of eye movement tracking and motion sensing is capable of understanding individual and group users’ behaviors simultaneously, and thus is a valid and reliable scheme in monitoring public activities that can be widely used in public large display systems.