Affiliation:
1. University College London, UK
Abstract
To peripheral vision, a pair of physically different images can look the same. Such pairs are
metamers
relative to each other, just as physically-different spectra of light are perceived as the same color. We propose a real-time method to compute such ventral metamers for foveated rendering where, in particular for near-eye displays, the largest part of the framebuffer maps to the periphery. This improves in quality over state-of-the-art foveation methods which blur the periphery. Work in Vision Science has established how peripheral stimuli are ventral metamers if their statistics are similar. Existing methods, however, require a costly optimization process to find such metamers. To this end, we propose a novel type of statistics particularly well-suited for practical real-time rendering: smooth moments of steerable filter responses. These can be extracted from images in time constant in the number of pixels and in parallel over all pixels using a GPU. Further, we show that they can be compressed effectively and transmitted at low bandwidth. Finally, computing realizations of those statistics can again be performed in constant time and in parallel. This enables a new level of quality for foveated applications such as such as remote rendering, level-of-detail and Monte-Carlo denoising. In a user study, we finally show how human task performance increases and foveation artifacts are less suspicious, when using our method compared to common blurring.
Funder
UK Research and Innovation
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design
Reference74 articles.
1. Manufacturing Application-Driven Foveated Near-Eye Displays
2. Latency requirements for foveated rendering in virtual reality;Albert Rachel;ACM Trans App Perc,2017
3. A chart demonstrating variations in acuity with retinal position
4. Beiträge zur Kenntniss des indirecten Sehens.(I). Untersuchungen über den Raumsinn der Retina;Aubert H;Archiv für Ophthalmologie,1857
5. Kernel-predicting convolutional networks for denoising Monte Carlo renderings
Cited by
29 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Perceptually Adaptive Real-Time Tone Mapping;SIGGRAPH Asia 2023 Conference Papers;2023-12-10
2. Is Foveated Rendering Perception Affected by Users’ Motion?;2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR);2023-10-16
3. The Perceptual Science of Augmented Reality;Annual Review of Vision Science;2023-09-15
4. One step closer to EEG based eye tracking;2023 Symposium on Eye Tracking Research and Applications;2023-05-30
5. Learning GAN-Based Foveated Reconstruction to Recover Perceptually Important Image Features;ACM Transactions on Applied Perception;2023-04-21