Affiliation:
1. Texas State University, San Marcos, TX, USA
2. Meta, Seattle, WA, USA
Abstract
This paper proposes a novel evaluation framework, termed "critical evaluation periods," for evaluating continuous gaze prediction models. This framework emphasizes prediction performance when it is most critical for gaze prediction to be accurate relative to user perception. Based on perceptual characteristics of the human visual system such as saccadic suppression, this framework provides a more practical assessment of gaze prediction performance for gaze-contingent rendering compared to the dominant sample-by-sample evaluation strategy employed in literature, which overemphasizes performance during easy-to-predict periods of fixation. Using a case study with a lightweight deep learning gaze prediction model, we observe a significant discrepancy in the reported prediction accuracy between the proposed critical evaluation periods and the dominant evaluation strategy employed in literature. Based on our findings, we suggest that the proposed framework is more suitable for evaluating the performance of continuous gaze prediction models intended for gaze-contingent rendering applications.
Funder
Meta
National Science Foundation
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)
Reference31 articles.
1. Latency Requirements for Foveated Rendering in Virtual Reality
2. James Anliker. 1976. Eye movements - On-line measurement analysis and control. James Anliker. 1976. Eye movements - On-line measurement analysis and control.
3. Saccade landing position prediction for gaze-contingent rendering
4. Saccadic omission: Why we do not see a grey-out during a saccadic eye movement
5. William Falcon et al. 2019. PyTorch Lightning. https://github.com/Lightning-AI/lightning William Falcon et al. 2019. PyTorch Lightning. https://github.com/Lightning-AI/lightning