Enhancing 360 Video Streaming through Salient Content in Head-Mounted Displays
Author:
Nguyen Anh1, Yan Zhisheng1
Affiliation:
1. Department of Information Sciences and Technology, School of Computing, George Mason University, Fairfax, VA 22030, USA
Abstract
Predicting where users will look inside head-mounted displays (HMDs) and fetching only the relevant content is an effective approach for streaming bulky 360 videos over bandwidth-constrained networks. Despite previous efforts, anticipating users’ fast and sudden head movements is still difficult because there is a lack of clear understanding of the unique visual attention in 360 videos that dictates the users’ head movement in HMDs. This in turn reduces the effectiveness of streaming systems and degrades the users’ Quality of Experience. To address this issue, we propose to extract salient cues unique in the 360 video content to capture the attentive behavior of HMD users. Empowered by the newly discovered saliency features, we devise a head-movement prediction algorithm to accurately predict users’ head orientations in the near future. A 360 video streaming framework that takes full advantage of the head movement predictor is proposed to enhance the quality of delivered 360 videos. Practical trace-driven results show that the proposed saliency-based 360 video streaming system reduces the stall duration by 65% and the stall count by 46%, while saving 31% more bandwidth than state-of-the-art approaches.
Funder
National Science Foundation
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference74 articles.
1. (2021, October 01). Markets. Virtual Reality Market. Available online: www.marketsandmarkets.com/Market-Reports/reality-applications-market-458.html. 2. Grand View Research (2021, October 01). Virtual Reality Market Size, Share & Trends Analysis Report by Technology (Semi & Fully Immersive, Non-Immersive), by Device (HMD, GTD), by Component (Hardware, Software), by Application, by Region, and Segment Forecasts, 2023–2030 & Trends Report, 2021–2028. Available online: www.grandviewresearch.com/industry-analysis/virtual-reality-vr-market. 3. Watanabe, K., Soneda, Y., Matsuda, Y., Nakamura, Y., Arakawa, Y., Dengel, A., and Ishimaru, S. (2021). Discaas: Micro behavior analysis on discussion by camera as a sensor. Sensors, 21. 4. Pavlič, J., and Tomažič, T. (2022). The (In) effectiveness of Attention Guidance Methods for Enhancing Brand Memory in 360° Video. Sensors, 22. 5. Škola, F., Rizvić, S., Cozza, M., Barbieri, L., Bruno, F., Skarlatos, D., and Liarokapis, F. (2020). Virtual reality with 360-video storytelling in cultural heritage: Study of presence, engagement, and immersion. Sensors, 20.
|
|