Development of a New Measure of Cognitive Ability Using Automatic Item Generation and Its Psychometric Properties

Abstract

In the development of cognitive science understanding human intelligence and mind, measurement of cognitive ability has played a key role. To address the development in data scientific point of views related to cognitive neuroscience, there has been a demand of creating a measurement to capture cognition in short and repeated time periods. This paper introduces an innovative measure of cognitive ability based on automatic item generation approach, which can efficiently and effectively measure cognitive ability over time. We also examine its psychometric properties. Content validity of the assessment was considered based on the Cattell-Horn-Carroll theory, and construct validity via convergent and divergent validities was examined by confirmatory factor analysis. The reliability of the measure examined by internal consistencies as well as test-retest reliabilities of each subdomain of cognitive ability were satisfactory. The psychometric properties found clearly support its potential utilities in both educational and clinical settings, especially in a field requiring repeated measures of cognitive ability.