Reliability of the Chinese VALPAR Pro3000 Modular Assessment System for Assessing Persons with Mental Illness

Abstract

Objective To assess the accuracy of translated instructions, items, content relevance, test–-retest reliability and interrater reliability of the Chinese version of three selected modules of the VALPAR Pro3000 Modular Assessment System for assessing persons with mental illness: (1) computerised assessment (COMPASS); (2) Physical, Environmental and Temperaments (PET) survey; and (3) spatial aptitude/nonverbal reasoning. Methods An expert panel of 12 experienced occupational therapists evaluated the translation and content validity. Twenty-nine participants completed all of the selected modules twice during a 10-day interval to assess the test–-retest reliability. To assess interrater reliability, two raters assessed the COMPASS work-sample tests taken by another 30 participants. Results Most of the COMPASS subtests had moderate to good retest reliability. The PET survey and spatial aptitude/nonverbal reasoning modules showed good retest reliability. Interrater reliability of the work samples was good. Conclusion The results of this study provide preliminary support for the reliability of the selected Pro3000 system modules in evaluating the work capabilities of people with mental illness.