An Item Response Theory to Analyze the Psychological Impacts of Rail-Transport Delay

Abstract

Questionnaire instruments have been used extensively by researchers in the literature review for evaluation of various aspects of public transportation. Important implications have been derived from those instruments to improve various aspects of the transport. However, it is important that instruments, which are designed to measure various stimuli, meet criteria of reliability to reflect a real impact of the stressors. Particularly, given the diverse range of commuter characteristics considered in this study, it is necessary to ensure that instruments are reliable and accurate. This can be achieved by finding the relationship between the item’s properties and the underlying unobserved trait, being measured. The item response theory (IRT) refers to measurement of an instrument’s reliability by examining the relationship between the unobserved trait and various observed items. In this study, to determine if our instrument suffers from any potentially associated problems, the IRT analysis was conducted. The analysis was employed based on the graded response model (GRM) due to the ordinal nature of the data. Various aspects of the instruments, such as discriminability and informativity of the items were tested. For instance, it was found while the classical test theory (CTT) confirm the reliability of the instrument, IRT highlight some concerns regarding the instrument. Also, the person fit assessment measure, for instance, highlights some concern regarding respondents answering some of the questions due to lack of interest, choosing answers randomly. Not many studies have examined instruments’ reliability in determining the psychological impacts of public transportation on commuters in the way that was performed here.