Investigating the multimedia pointing techniques in the tabletop-centric cross-device interaction

Abstract

AbstractGroup collaboration needs the support of a digital interaction system composed of a tabletop-centric shared display and individual operational physical cursors and mobile devices. We examine the usability of a fundamental function of the system, i.e., the pointing techniques. Direct pointing refers to the selection with a cursor placed on the target object, and proximity pointing requires the cursor nearby the target object. The empirical evidence from sixty-two participants shows that the direct pointing technique, although proved as the best choice in single device interaction, is inferior to proximity pointing in cross-device interaction in completion time and operation correctness. We also examine how the display for confirmation on mobile devices fits for pointing technique, discuss how users habituated to single device interaction adapt to cross-device interaction, and suggest guidelines for the design practice.