Affiliation:
1. Saint Petersburg State University
2. Perm State University
Abstract
This paper is devoted to extending the previously created unified pipeline for conducting eye-tracking- based experiments in a virtual reality environment. In the previous work, we proposed using SciVi semantic data mining platform, Unreal Engine and HTC Vive Pro Eye head-mounted display to study reading process in the immersive virtual reality. The currently proposed extension enables to handle so-called polycode stimuli: compound visual objects, which consist of individual parts carrying different semantics for the viewer. To segment polycode stimuli extracting areas of interest (areas, where the informant’s eye gaze is being tracked) we adopt Creative Maps Studio vector graphics editor. To integrate Creative Maps Studio into the existing pipeline we created plugins for SciVi platform to load and handle the segmented stimuli, place them in the virtual reality scenes, collect corresponding eye gaze tracking data and perform visual analysis of the data collected. To analyze the eye gaze tracks, we utilize a circular graph that allows comprehensive visualization of hierarchical areas of interest (mapping them to color- coded graph nodes grouped into the hierarchy with a help of multilevel circular scale) and corresponding eye movements (mapped to the graph edges). We tested our pipeline on two different stimuli: the advertising poster and the painting “The Appearance of Christ Before the People” by A. Ivanov (1857).
Publisher
Keldysh Institute of Applied Mathematics
Reference27 articles.
1. K. Rayner, K. H. Chace, T. J. Slattery, J. Ashby, Eye Movements as Reflections of Comprehension Processes in Reading, Scientific Studies of Reading 10 (2006) 241–255. doi:10.1207/s1532799xssr1003_3.
2. K. Rayner, Eye Movements in Reading and Information Processing: 20 Years of Research, Psychological Bulletin 124 (1998) 372–422. doi:10.1037/0033- 2909.124.3.372.
3. D. Sonntag, J. Orlosky, M. Weber, Y. Gu, S. Sosnovsky, T. Toyama, E. N. Toosi, Cognitive Monitoring via Eye Tracking in Virtual Reality Pedestrian Environments, in: Proceedings of the 4th International Symposium on Pervasive Displays, 2015, pp. 269–270. doi:10.1145/2757710.2776816.
4. K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, J. van de Weijer, Eye Tracking: A Comprehensive Guide To Methods And Measures, OUP Oxford, 2011.
5. Tobii, 2021. URL: https://www.tobii.com, last accessed 8 Jul 2021.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献