Measuring motion-to-photon latency for sensorimotor experiments with virtual reality systems

Abstract

AbstractConsumer virtual reality (VR) systems are increasingly being deployed in research to study sensorimotor behaviours, but properties of such systems require verification before being used as scientific tools. The ‘motion-to-photon’ latency (the lag between a user making a movement and the movement being displayed within the display) is a particularly important metric as temporal delays can degrade sensorimotor performance. Extant approaches to quantifying this measure have involved the use of bespoke software and hardware and produce a single measure of latency and ignore the effect of the motion prediction algorithms used in modern VR systems. This reduces confidence in the generalisability of the results. We developed a novel, system-independent, high-speed camera-based latency measurement technique to co-register real and virtual controller movements, allowing assessment of how latencies change through a movement. We applied this technique to measure the motion-to-photon latency of controller movements in the HTC Vive, Oculus Rift, Oculus Rift S, and Valve Index, using the Unity game engine and SteamVR. For the start of a sudden movement, all measured headsets had mean latencies between 21-42ms. Once motion prediction could account for the inherent delays, the latency was functionally reduced to 2-13ms, and our technique revealed this reduction occurs within ∼25-58ms of movement onset. Our findings indicate that sudden accelerations (e.g. movement onset, impacts and direction changes) will increase latencies and lower spatial accuracy. Our technique allows researchers to measure these factors and determine the impact on their experimental design before collecting sensorimotor data from VR systems.