Automatic Generation of Customized Areas of Interest and Evaluation of Observers' Gaze in Portrait Videos-Reference-Cited by-同舟云学术

Automatic Generation of Customized Areas of Interest and Evaluation of Observers' Gaze in Portrait Videos

Published:2022-05-13 Issue:ETRA Volume:6 Page:1-14
ISSN:2573-0142
Container-title:Proceedings of the ACM on Human-Computer Interaction
language:en
Short-container-title:Proc. ACM Hum.-Comput. Interact.

Author:

Woehler Leslie¹,von Estorff Moritz¹,Castillo Susana¹,Magnor Marcus¹

Affiliation:

1. TU Braunschweig, Braunschweig, Germany

Abstract

We present a novel framework for the evaluation of eye tracking data in portrait videos including the automatic generation of customized areas of interest (AOIs) based on facial landmarks. In contrast to previous work, our framework allows the user to flexibly create AOIs by grouping the detected landmarks. Moreover, their shape and size can be modified to better fit both the research question and the precision of the eye tracker. The framework can be used as an integrated solution to not only generate AOIs but also to evaluate viewing behavior like the overall fixation times, the similarity of scanpaths, and the number of saccades between AOIs. Other functionalities include the visualization of gaze paths and the creation of heatmaps. We demonstrate the benefits of our framework and user-defined AOI layouts via an exemplary application, i.e., the investigation of face swapping artifacts.

Funder

L3S Research Center, Hannover

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)

Link

https://dl.acm.org/doi/pdf/10.1145/3530885

Reference40 articles.

1. Eye-movement-based memory effect: A reprocessing effect in face perception.

2. Tadas Baltruvs aitis, Peter Robinson , and Louis-Philippe Morency . 2016 . Openface: an open source facial behavior analysis toolkit . In IEEE Winter Conference on Applications of Computer Vision. IEEE, IEEE , Manhattan, NY, USA, 1--10. https://doi.org/10.1109/WACV. 2016.7477553 10.1109/WACV.2016.7477553 Tadas Baltruvs aitis, Peter Robinson, and Louis-Philippe Morency. 2016. Openface: an open source facial behavior analysis toolkit. In IEEE Winter Conference on Applications of Computer Vision. IEEE, IEEE, Manhattan, NY, USA, 1--10. https://doi.org/10.1109/WACV.2016.7477553

3. Looking at faces

4. Elina Birmingham and Alan Kingstone . 2009. Human social attention. Progress in brain research , Vol. 176 ( 2009 ), 309--320. https://doi.org/10.1016/S0079--6123(09)17618--5 10.1016/S0079--6123(09)17618--5 Elina Birmingham and Alan Kingstone. 2009. Human social attention. Progress in brain research , Vol. 176 (2009), 309--320. https://doi.org/10.1016/S0079--6123(09)17618--5

5. Featural, Configural, and Holistic Face-Processing Strategies Evoke Different Scan Patterns