A Study on the Application of Multi-sensory Interaction Technology in Enhancing Concert Audience Immersion

Abstract

Abstract The progress of multi-sensory interaction technology provides technical support for creating immersive concerts full of participation and experience. Based on multi-sensory interaction technology, this study proposes the design idea of immersive concerts and outlines the application process of multi-sensory interaction technology in immersive concerts. It builds a concert virtual reality scene through emotion recognition and evocation in the virtual reality scene, designs a gesture interaction interface based on immersive flow field visualization, realizes the construction of an immersive concert, and carries out application evaluation. The model's emotion recognition rate is as high as 93.04%, and after the resting state adjustment, the subjects’ pleasantness and arousal are on the rise, and the ability to evoke emotions is consistent with the expectation. The experimental expectations were met as the mean values of realism and immersion scores were not below 7.6. The percentage of user agreement for clicking and pinching gestures is concentrated in rank 4 and rank 3, and the percentage of voting for comfort is concentrated in rank 2 and reaches 96% and 91%, respectively, which can meet the interaction needs of immersive concerts. This paper presents technical ideas for using multisensory interaction technology in immersive concerts.