Abstract
A touch interface is an important technology used in many devices, including touch panels in smartphones. Many touch panels only detect the contact position. If devices can detect shear force in addition to the contact position, various touch interactions are possible. We propose a two-step recognition method for recognizing the pressing position and shear force using active acoustic sensing, which transmits acoustic signals to an object and recognizes the state of the object by analyzing its response. Specifically, we attach a contact speaker transmitting an ultrasonic sweep signal and a contact microphone receiving ultrasonic waves to a plate of gel. The propagation characteristics of ultrasonic waves differ due to changes in the shape of the gel caused by the user’s actions on the gel. This system recognizes the pressing position and shear force on the basis of the difference in acoustic characteristics. An evaluation of our method involving a user-independent model confirmed that four pressing positions were recognized with an F1 score of 85.4%, and four shear-force directions were recognized with an F1 score of 69.4%.
Funder
Japan Science and Technology Agency
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference26 articles.
1. Feature and Technology Trends of Various Touch Panels;Mitani;Nippon. Gomu Kyokaishi,2011
2. Apple (2022, December 15). Technical Specifications. Available online: https://support.apple.com/kb/SP726?viewlocale=en_US&locale=ja_JP.
3. Watanabe, K., Yamamura, R., and Kakehi, Y. (2021, January 8–13). Foamin: A Deformable Sensor for Multimodal Inputs Based on Conductive Foam with a Single Wire. Proceedings of the CHI EA ’21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan. Number Article 189.
4. Nakai, Y., Kudo, S., Okazaki, R., Kajimoto, H., and Kuribayashi, H. (May, January 26). Detection of tangential force for a touch panel using shear deformation of the gel. Proceedings of the CHI EA ’14: CHI ’14 Extended Abstracts on Human Factors in Computing Systems, Toronto, ON, Canada.
5. Moscovich, T. (2006, January 22–27). Multi-touch interaction. Proceedings of the CHI EA ’06: CHI ’06 Extended Abstracts on Human Factors in Computing Systems, Montréal, QC, Canada.