A study of hand-movement gestures to substitute for mouse-cursor placement using an inertial sensor

Abstract

Abstract. This paper examines the new study of hand orientation as a substitute for computer-mouse movement and is evaluated based on ISO/TS 9241 part 411: Ergonomics of human–system interaction-evaluation methods for the design of physical input devices. Two pairs of hand-orientation candidates were evaluated, using, for example, pitch–roll and pitch–yaw to substitute for up–down and left–right mouse-cursor movements. The up–down cursor movement was generated from the pitch orientation, while the left–right cursor movement was generated from the roll or yaw orientation, depending on the evaluation of the proposed gesture. The research employed a standard computer mouse as a baseline comparison for the study. The empirical study was conducted to evaluate quantitative performance such as throughput and movement time. The best impression resulted when the throughput had the greatest value as well as the shortest movement time. The performance test was based on Fitts's law using a multi-directional tapping test as suggested by ISO/TS 9241-411. The test was divided into several levels of difficulty, including high, medium, low, and very low. The other assessment is qualitative and was performed using the comfort-rating scale questionnaire and rating of perceived exertion of comfortability and fatigue. The quantitative results show that pitch–yaw throughput is slightly higher than for the pitch–roll gesture, and that the movement time in pitch–yaw is slightly less than in pitch–roll, although there is no statistically significant difference between the two. We also found that pitch–yaw movements have a higher level of comfort based on the comfort-rating scale test. Since the test was divided into levels of difficulty, we identified those gestures suitable for the task with a low and very low level of difficulty based on throughput, movement time, and error-rate results. Finally, this study suggests that pitch–roll and pitch–yaw movements of the hand can be used as substitutes for the mouse, and that pitch–yaw movements are superior in regard to causing less fatigue than pitch–roll movements. Furthermore, this study provides a new suggestion for a suitable level of difficulty when using an inertial sensor as an emulator for the movement of a mouse cursor in the field of human–computer interaction.