FocalPoint-Reference-Cited by-同舟云学术

FocalPoint

Published:2022-03-27 Issue:1 Volume:7 Page:1-26
ISSN:2474-9567
Container-title:Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
language:en
Short-container-title:Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

Author:

Ma Jiaju¹^ORCID,Qian Jing²^ORCID,Zhou Tongyu²^ORCID,Huang Jeff²^ORCID

Affiliation:

1. Brown University, United States, Stanford University, United States

2. Brown University, United States

Abstract

We propose FocalPoint, a direct manipulation technique in smartphone augmented reality (AR) for selecting small densely-packed objects within reach, a fundamental yet challenging task in AR due to the required accuracy and precision. FocalPoint adaptively and continuously updates a cylindrical geometry for selection disambiguation based on the user's selection history and hand movements. This design is informed by a preliminary study which revealed that participants preferred selecting objects appearing in particular regions of the screen. We evaluate FocalPoint against a baseline direct manipulation technique in a 12-participant study with two tasks: selecting a 3 mm wide target from a pile of cubes and virtually decorating a house with LEGO pieces. FocalPoint was three times as accurate for selecting the correct object and 5.5 seconds faster on average; participants using FocalPoint decorated their houses more and were more satisfied with the result. We further demonstrate the finer control enabled by FocalPoint in example applications of robot repair, 3D modeling, and neural network visualizations.

Funder

National Science Foundation

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Hardware and Architecture,Human-Computer Interaction

Link

https://dl.acm.org/doi/pdf/10.1145/3580856

Reference77 articles.

1. Shan An , Xiajie Zhang , Dong Wei , Haogang Zhu , Jianyu Yang , and Konstantinos A . Tsintotas . 2021 . Fast Monocular Hand Pose Estimation on Embedded Systems . https://doi.org/10.48550/ARXIV.2102.07067 10.48550/ARXIV.2102.07067 Shan An, Xiajie Zhang, Dong Wei, Haogang Zhu, Jianyu Yang, and Konstantinos A. Tsintotas. 2021. Fast Monocular Hand Pose Estimation on Embedded Systems. https://doi.org/10.48550/ARXIV.2102.07067

2. C. Andujar and F. Argelaguet . 2006. Friction surfaces: scaled ray-casting manipulation for interacting with 2D GUIs . In Eurographics Symposium on Virtual Environments, Ming Lin and Roger Hubbold (Eds.). The Eurographics Association. https://doi.org/10 .2312/EGVE/EGVE06/ 101 - 108 10.2312/EGVE C. Andujar and F. Argelaguet. 2006. Friction surfaces: scaled ray-casting manipulation for interacting with 2D GUIs. In Eurographics Symposium on Virtual Environments, Ming Lin and Roger Hubbold (Eds.). The Eurographics Association. https://doi.org/10.2312/EGVE/EGVE06/101-108

3. Performance and Ergonomics of Touch Surfaces

4. Felipe Bacim , Mahdi Nabiyouni , and Doug A. Bowman . 2014. Slice-n-Swipe: A free-hand gesture user interface for 3D point cloud annotation . In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 185--186 . https://doi.org/10.1109/3DUI. 2014 .6798882 10.1109/3DUI.2014.6798882 Felipe Bacim, Mahdi Nabiyouni, and Doug A. Bowman. 2014. Slice-n-Swipe: A free-hand gesture user interface for 3D point cloud annotation. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 185--186. https://doi.org/10.1109/3DUI.2014.6798882

5. Huidong Bai , Gun A. Lee , Mukundan Ramakrishnan , and Mark Billinghurst . 2014. 3D Gesture Interaction for Handheld Augmented Reality . In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications (Shenzhen, China) (SA '14) . Association for Computing Machinery , New York, NY, USA , Article 7, 6 pages. https://doi.org/10.1145/2669062.2669073 10.1145/2669062.2669073 Huidong Bai, Gun A. Lee, Mukundan Ramakrishnan, and Mark Billinghurst. 2014. 3D Gesture Interaction for Handheld Augmented Reality. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications (Shenzhen, China) (SA '14). Association for Computing Machinery, New York, NY, USA, Article 7, 6 pages. https://doi.org/10.1145/2669062.2669073