Affiliation:
1. TU Darmstadt, Darmstadt, Hessen, Germany
Abstract
Tangible interaction has shown to be beneficial in a wide variety of scenarios since it provides more direct manipulation and haptic feedback. Further, inherently three-dimensional information is represented more naturally by a 3D object than by a flat picture on a screen. Yet, today's tangibles have often pre-defined form factors and limited input and output facilities. To overcome this issue, the combination of projection and depth cameras is used as a fast and flexible way of non-intrusively adding input and output to tangibles. However, tangibles are often quite small and hence the space for output and interaction on their surface is limited. Therefore, we propose FlowPut: an environment-aware framework that utilizes the space available on and around a tangible object for projected visual output. By means of an optimization-based layout approach, FlowPut considers the environment of the objects to avoid interference between projection and real-world objects. Moreover, we contribute an occlusion resilient object recognition and tracking for tangible objects based on their 3D model and a point-cloud based multi-touch detection, that allows sensing touches also on the side of a tangible. Flowput is validated through a series of technical experiments, a user study, and two example applications.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Hardware and Architecture,Human-Computer Interaction
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. A toolkit for automatically generating and modifying VR hierarchy tile menus;Computer Animation and Virtual Worlds;2023-10-06
2. UbiChromics: Enabling Ubiquitously Deployable Interactive Displays with Photochromic Paint;Proceedings of the ACM on Human-Computer Interaction;2022-11-14
3. Dynamic Decals;Proceedings of the ACM on Human-Computer Interaction;2021-11-03
4. SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic Connections;The 34th Annual ACM Symposium on User Interface Software and Technology;2021-10-10
5. Wwall;Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion;2019-06-18