Examining the Factor Structure and Measurement Invariance of Test Emotions Across Testing Platform, Gender, and Time

Abstract

Few studies have examined the psychometric properties of the test-related items from the Achievement Emotions Questionnaire (AEQ). Using a sample of 955 university students, we examined the factor structure of 12 emotion items measuring test-related anger, boredom, enjoyment, and pride. Results indicated the four emotions were distinct, allowing for further examination of measurement invariance of the items across testing platform (computer-based vs. pencil-paper test) and gender. Configural, metric, and scalar invariance was supported for testing platform and gender. Given interest in modeling change in emotions, we also examined whether the items were invariant across time by measuring emotions at 3 times during a test. Using a sample of 651 university students, configural, metric, and scalar invariance was supported across time. The findings provide important structural validity evidence for the item responses and support the comparison of emotions across testing platform, gender, and time.