Affiliation:
1. School of Information and Electronics, Beijing Institute of Technology, Beijing 100811, China
2. Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100045, China
3. China Electronics Standardization Institute, Beijing 101102, China
Abstract
Due to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ideal. In this study, we focus on two typical virtual reality (VR) application scenarios with immersive audio and video experience: VR conferencing and panoramic live broadcast. We begin by introducing the core principles of traditional video conferencing, followed by the existing research results of VR conferencing along with the similarities, differences, pros, and cons of each solution. Then, we outline our view about what elements a virtual conferencing room should have. After that, a simple implementation scheme for VR conferencing is provided. Regarding panoramic video, we introduce the steps to produce and transmit a panoramic live broadcast and analyze several current mainstream encoding optimization schemes. By comparing traditional video streams, the various development bottlenecks of panoramic live broadcast are identified and summarized. A simple implementation of a panoramic live broadcast is presented in this paper. To conclude, the main points are illustrated along with the possible future directions of the two systems. The simple implementation of two immersive systems provides a research and application reference for VR audio and video transmission, which can guide subsequent relevant research studies.
Funder
National Natural Science Foundation of China
Beijing Natural Science Foundation
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference55 articles.
1. Enhancing Our Lives with Immersive Virtual Reality;Mel;Front. Robot. AI,2016
2. Santana, A., Lira, A., Lara, G., and Pena, A. (2018, January 17–19). Evolution of Virtual Reality’s Interaction Devices. Proceedings of the 2018 7th International Conference On Software Process Improvement (CIMPS), Guadalajara, Mexico.
3. Application of Virtual Reality, Augmented Reality, and Mixed Reality in Endourology and Urolithiasis: An Update by YAU Endourology and Urolithiasis Working Group;Hameed;Front. Surg.,2022
4. Survey of VR applications in interactive films and games;Zhang;J. Shanghai Univ.,2017
5. Tan, Q.P., Huang, L., Xu, D., Cen, Y., and Cao, Q. (2022). Serious Game for VR Road Crossing in Special Needs Education. Electronics, 11.
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献