Affiliation:
1. MIT Media Lab, USA
2. EPFL, Switzerland
3. University of Costa Rica, Costa Rica
4. Wellesley College, USA
Abstract
Hand-to-Face transmission has been estimated to be a minority, yet non-negligible, vector of COVID-19 transmission and a major vector for multiple other pathogens. At the same time, as it cannot be effectively addressed with mainstream protection measures, such as wearing masks or tracing contacts, it remains largely untackled. To help address this issue, we have developed Saving Face - an app that alerts users when they are about to touch their faces, by analyzing the distortion patterns in the ultrasound signal emitted by their earphones. The system only relies on pre-existing hardware (a smartphone with generic earphones), which allows it to be rapidly scalable to billions of smartphone users worldwide. This paper describes the design, implementation and evaluation of the system, as well as the results of a user study testing the solution's accuracy, robustness, and user experience during various day-to-day activities (93.7% Sensitivity and 91.5% Precision, N=10). While this paper focuses on the system's application to detecting hand-to-face gestures, the technique can also be applicable to other types of gestures and gesture-based applications.
Funder
NSF
Swiss National Science Foundation
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Hardware and Architecture,Human-Computer Interaction
Cited by
9 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. The EarSAVAS Dataset;Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies;2024-05-13
2. MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture Interactions;Proceedings of the CHI Conference on Human Factors in Computing Systems;2024-05-11
3. Enabling WiFi Sensing on New-generation WiFi Cards;Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies;2023-12-19
4. FaceTouch: Practical Face Touch Detection with a Multimodal Wearable System for Epidemiological Surveillance;Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation;2023-05-09
5. Face touch monitoring using an instrumented wristband using dynamic time warping and k-nearest neighbours;PLOS ONE;2023-02-17