Development and Validation of an Evaluation Tool to Measure the Effectiveness of a Smoking Cessation Training among Healthcare Providers in Malaysia: The Providers’ Smoking Cessation Training Evaluation (ProSCiTE)

Abstract

Background: In line with Article 14 of the Framework Convention for Tobacco Control, we have witnessed vast developments in smoking cessation training for healthcare providers, offering help for smokers. However, there is no specific evaluation tool to monitor and evaluate the effectiveness of these programs for future enhancement and sustainability. Objective: To develop and validate a new tool for evaluating smoking cessation training programs for healthcare providers called the Providers’ Smoking Cessation Training Evaluation (ProSCiTE). Methods: The 74-item ProSCiTE tool was developed based on a review of the literature and an expert panel review. The tool was validated in a sample of 403 healthcare providers using a cross-sectional study design from July to December 2016. Content validity was assessed by the Scale-Content Validity Index (S-CVI). The construct validity of the ProSCiTE was analyzed using exploratory factor analysis (EFA) to confirm psychometric properties. Internal consistency reliability was determined using Cronbach’s alpha. Results: The content validity showed that the S-CVI ranged from 0.82 to 1.00 for consistency, representativeness, relevancy, and the clarity of each construct, resulting in 67 items for the questionnaire. The construct validity of the ProSCiTE (based on eigenvalues and factor loadings to confirm the four-factor structure (attitude, self-efficacy, behavior, and barriers) with 54.74% total variance) was acceptable (Kaiser-Mayer-Olkin = 0.923; Bartlett’s test of sphericity was significant, p < 0.001). The internal consistency reliability of the four-factor structure was very good, with Cronbach’s alpha values at 0.89, 0.94, 0.95, and 0.90, respectively. Conclusions: This study showed that 67 items of the ProSCiTE demonstrated good content and construct validity, as well as a high internal consistency reliability for the measurement of knowledge, attitudes, self-efficacy, behavior, and barriers to smoking cessation interventions among healthcare providers. Therefore, the ProSCiTE is a valid and reliable research tool with which to evaluate the effectiveness of smoking cessation training programs.