Author:
Barz Michael,Bhatti Omair Shahzad,Sonntag Daniel
Abstract
Eye movements were shown to be an effective source of implicit relevance feedback in constrained search and decision-making tasks. Recent research suggests that gaze-based features, extracted from scanpaths over short news articles (g-REL), can reveal the perceived relevance of read text with respect to a previously shown trigger question. In this work, we aim to confirm this finding and we investigate whether it generalizes to multi-paragraph documents from Wikipedia (Google Natural Questions) that require readers to scroll down to read the whole text. We conduct a user study (n = 24) in which participants read single- and multi-paragraph articles and rate their relevance at the paragraph level with respect to a trigger question. We model the perceived document relevance using machine learning and features from the literature as input. Our results confirm that eye movements can be used to effectively model the relevance of short news articles, in particular if we exclude difficult cases: documents which are on topic of the trigger questions but irrelevant. However, our results do not clearly show that the modeling approach generalizes to multi-paragraph document settings. We publish our dataset and our code for feature extraction under an open source license to enable future research in the field of gaze-based implicit relevance feedback.
Funder
Bundesministerium für Bildung und Forschung
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. The ensemble of neural networks to track eye movements;2023 IEEE 18th International Conference on Computer Science and Information Technologies (CSIT);2023-10-19
2. Evaluating the Feasibility of Predicting Information Relevance During Sensemaking with Eye Gaze Data;2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR);2023-10-16
3. Predicting Co-occurring Emotions in MetaTutor when Combining Eye-Tracking and Interaction Data from Separate User Studies;LAK23: 13th International Learning Analytics and Knowledge Conference;2023-03-13
4. The Predictive Effect of Eye-Movement Behavior on Reading Performance in Online Reading Contexts;Proceedings of the 14th International Conference on Education Technology and Computers;2022-10-28
5. Interactive Assessment Tool for Gaze-based Machine Learning Models in Information Retrieval;ACM SIGIR Conference on Human Information Interaction and Retrieval;2022-03-14