The Store-and-Forward Telemedicine Service User-satisfaction Questionnaire: Development and validation of a questionnaire to monitor and assess health care providers' experiences

Abstract

Introduction With wider adoption of store-and-forward telemedicine accelerating, particularly post-coronavirus disease 2019, it is essential to understand health care providers’ (HCPs) satisfaction with digital solutions offered by telemedicine organizations to (continuously) guarantee service quality. We developed the Store-and-Forward Telemedicine Service User-satisfaction Questionnaire to monitor and assess HCPs’ experiences with contracted telemedicine organizations. Methods Questionnaire construction (phase 1) consisted of exploratory literature search on validated telemedicine satisfaction questionnaires, a telemedicine domain and human factors expert focus group, stakeholder focus group (customer service employee and telemedicine account managers), and two pre-testing rounds among 18 HCPs. The pilot questionnaire (phase 2) was sent to 2179 HCPs for validity and reliability assessment. Results Phase 1: Two validated questionnaires (73 items overall) were used as input for Store-and-Forward Telemedicine Service User-satisfaction Questionnaire. Revisions resulted in 61 items. Phase 2: the pilot 61-item Store-and-Forward Telemedicine Service User-satisfaction Questionnaire instrument was completed by 181 of 2179 invited HCPs. Forty-one mandatory items of the pilot Store-and-Forward Telemedicine Service User-satisfaction Questionnaire rated on a 5-point Likert scale were included in psychometric analyses and resulted in six reliable scales: training, communication, organization policy and strategy, interaction platform, usage platform, and working conditions. Discussion The Store-and-Forward Telemedicine Service User-satisfaction Questionnaire is a reliable and valid questionnaire for measuring HCPs’ satisfaction with store-and-forward telemedicine services as part of a continuous quality improvement cycle. Reimbursement questions were excluded due to low response. As adoption of telemedicine may be impeded by financial compensation issues, this requires consideration in future telemedicine questionnaires. Store-and-Forward Telemedicine Service User-satisfaction Questionnaire including video consultation items is needed to monitor also synchronous services as these expanded in the coronavirus disease 2019 pandemic.