Virtual Flower Visualization System Based on Somatosensory Interaction

Abstract

Somatosensory interaction has already become a research focus with the rapid development of virtual reality (VR) technologies, which has been widely applied in the field of computer vision. However, the task is very challenging because of the serious penetrating phenomena in the process of interaction and the high complexity of the gesture recognition problem. For these issues, we present a feasible solution that solves the problem of finger penetration in virtual flower interaction process, which includes the details of virtual hand position mapping, object collision detection, and finger position optimization. After analyzing the requirements associated with hand gesture in virtual flower interaction, we propose a finger gesture-based method to recognize the custom gestures, which utilized Particle Swarm Optimization (PSO) algorithm to optimize the trajectory of fingertips and joints. In addition, a prototype of virtual flower somatosensory interaction system has been designed and implemented for interactive forestry application, and the prototype evaluation has been given through users’ experiments. Experimental results show that the proposed methods can effectively solve the problem of finger penetration during grasping, accurately identify the custom gestures, and provide a more natural, intuitive and efficient user experience compared with the traditional interaction.