Affiliation:
1. New York University
2. University of Rochester
Abstract
Battery life is an increasingly urgent challenge for today's untethered VR and AR devices. However, the power efficiency of head-mounted displays is naturally at odds with growing computational requirements driven by better resolution, refresh rate, and dynamic ranges, all of which reduce the sustained usage time of untethered AR/VR devices. For instance, the Oculus Quest 2, under a fully-charged battery, can sustain only 2 to 3 hours of operation time. Prior display power reduction techniques mostly target smartphone displays. Directly applying smartphone display power reduction techniques, however, degrades the visual perception in AR/VR with noticeable artifacts. For instance, the "power-saving mode" on smartphones
uniformly
lowers the pixel luminance across the display and, as a result, presents an overall darkened visual perception to users if directly applied to VR content.
Our key insight is that VR display power reduction must be cognizant of the gaze-contingent nature of high field-of-view VR displays. To that end, we present a gaze-contingent system that, without degrading luminance, minimizes the display power consumption while preserving high visual fidelity when users actively view immersive video sequences. This is enabled by constructing 1) a gaze-contingent color discrimination model through psychophysical studies, and 2) a display power model (with respect to pixel color) through real-device measurements. Critically, due to the careful design decisions made in constructing the two models, our algorithm is cast as a constrained optimization problem with a
closed-form
solution, which can be implemented as a real-time, image-space shader. We evaluate our system using a series of psychophysical studies and large-scale analyses on natural images. Experiment results show that our system reduces the display power by as much as 24% (14% on average) with little to no perceptual fidelity degradation.
Funder
National Science Foundation
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design
Reference74 articles.
1. A 30 Year Retrospective on Dennard's MOSFET Scaling Paper
2. ML Boroson , JE Ludwicki , and MJ Murdoch . US Patent 7,586,497 , Sep. 8 , 2009 . OLED display with improved power performance. ML Boroson, JE Ludwicki, and MJ Murdoch. US Patent 7,586,497, Sep. 8, 2009. OLED display with improved power performance.
3. Visual pigments of rods and cones in a human retina.
4. Visual sensitivity for luminance and chromatic stimuli during the execution of smooth pursuit and saccadic eye movements
5. Temperature–Color Interaction: Subjective Indoor Environmental Perception and Physiological Responses in Virtual Reality
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献