Affiliation:
1. University of Bayreuth, Bayreuth, Germany
Abstract
Optimal feedback control (OFC) is a theory from the motor control literature that explains how humans move their body to achieve a certain goal, e.g., pointing with the finger. OFC is based on the assumption that humans aim at controlling their body optimally, within the constraints imposed by body, environment, and task. In this article, we explain how this theory can be applied to understanding Human-Computer Interaction (HCI) in the case of pointing. We propose that the human body and computer dynamics can be interpreted as a single dynamical system. The system state is controlled by the user via muscle control signals, and estimated from observations. Between-trial variability arises from signal-dependent control noise and observation noise. We compare four different models from optimal control theory and evaluate to what degree these models can replicate movements in the case of mouse pointing. We introduce a procedure to identify parameters that best explain observed user behavior. To support HCI researchers in simulating, analyzing, and optimizing interaction movements, we provide the Python toolbox
OFC4HCI
. We conclude that OFC presents a powerful framework for HCI to understand and simulate motion of the human body and of the interface on a moment-by-moment basis.
Publisher
Association for Computing Machinery (ACM)
Subject
Human-Computer Interaction
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Sensorimotor Simulation of Redirected Reaching using Stochastic Optimal Feedback Control;Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems;2023-04-19
2. Multimodal Emotion Recognition System Through Three Different Channels (MER-3C);Advanced Concepts for Intelligent Vision Systems;2023
3. Simulating Interaction Movements via Model Predictive Control;ACM Transactions on Computer-Human Interaction;2022-12-20
4. Breathing Life Into Biomechanical User Models;The 35th Annual ACM Symposium on User Interface Software and Technology;2022-10-28