Face, content, criterion and construct validity assessment of a newly developed tool to assess and classify work–related stress (TAWS– 16)

Abstract

Introduction As work-stress, is associated with Non Communicable Diseases, and decreased work productivity, health and economic benefits are expected from periodic work-stress screening among employees using valid and reliable tools. Tool to Assess and classify Work Stress (TAWS– 16) was developed to overcome limitations in existing work-stress assessment tools in India. This study aims to test face, content, criterion and construct validity of TAWS– 16 in a sample of managerial-supervisory employees. Methods Nine domain experts rated face and content validity of TAWS– 16. Content validity was measured by Content Validity Indices (I-CVI, S-CVI) and Modified Kappa statistics. Empirical validity was tested by analysing data reported from 356 Information Technology (IT) professionals wherein Exploratory Factor Analysis was conducted for the assessment of Construct Validity. Self-reported data was collected in an unlinked and anonymous manner using a web-link, which was emailed to the study subjects, after initial introductory telephone or personal conversation. Criterion Validity was tested against stress sub-scale of DASS– 21. This study was approved by NIMHANS ethics committee. Results Findings revealed that TAWS– 16 has good face validity. The content validity is acceptable (CVI = 0.829). Construct Validity is appropriate as 60.8% of the total variance was explained by the factors identified in our study. Criterion Validity was moderate (Kappa Value 0.208) due to inappropriate work-stress instrument for comparison with TAWS– 16. Conclusions Overall, TAWS– 16 demonstrated good face, content and construct validity. It measures work-stressors, coping abilities and psycho-somatic symptoms associated with work-stress. We recommend use of TAWS– 16 for periodic screening and classification of work-stress among employees.