An Evaluation Method of Visualization Using Visual Momentum Based on Eye-Tracking Data

Abstract

A new method based on eye-tracking data — visual momentum (VM) — was introduced to quantitatively evaluate a dynamic interactive visualization interface. We extracted the dimensionless factors from the raw eye-tracking data, including the fixation time factor [Formula: see text], the saccade amplitude factor D and the fixation number factor [Formula: see text]. A predictive regression model of VM was deduced by eye movement factors and the performance response time (RT). In Experiment 1, the experimental visualization materials were designed with six effectiveness levels according to design techniques proposed by Woods to improve VM (total replacement, fixed format data replacement, long shot, perceptual landmark and spatial representation) and were tested in six parallel subject groups. The coefficients of the regression model were calculated from the data of 42 valid subjects in Experiment 1. The mean VM of each group exhibited an increasing trend with an increase in design techniques. The data of the performance and eye tracking among the combined high VM group, middle VM group and low VM group indicated significant differences. The data analysis indicates that the results were consistent with the previous qualitative research of VM. We tested and verified this regression model in Experiment 2 with another dynamic interactive visualization. The results indicated that the VM calculated by the regression model was significantly correlated with the performance data. Therefore, the virtual parameter VM can be a quantitative indicator for evaluating dynamic visualization. It could be a useful evaluation method for the dynamic visualization in general working environments.