Design and development of a Telemedicine Assessment Toolkit (TAT) for the assessment of audiovisual telemedicine encounters

Abstract

Although the use of audiovisual telemedicine has grown in recent years especially during recent COVID-19-related lockdowns, evidence shows there is still a lack of tools that can be used for the assessment of telemedicine encounters. The few validated questionnaires that are available for assessing telemedicine encounters are not often used. Non-validated questionnaires dominate research, leading to results that cannot be compared or extrapolated to other research or medical sites. Development of standard measures for the assessment of telemedicine encounters has been advocated by stakeholders. The objective of this study is to provide a comprehensive set of measures by developing a conceptual approach and a preliminary Telemedicine Assessment Toolkit (TAT) for the assessment of audiovisual telemedicine encounters. A two-step conceptual approach was used to identify potential domains and sub-domains by qualitative analysis of a pool of questions from studies published from 2016 to 2021. Questions were adopted from validated questionnaires or generated to represent the underlying concept of each sub-domain, resulting in a core block of comprehensive questions. A toolkit is proposed with question-measures that cover the sub-domains relevant to the assessment of telemedicine encounters. This study recommended 11 domains to be used for the assessment of telemedicine encounters: “usability,” “patient satisfaction,” “patient–provider interaction,” “patient perspectives,” “telemedicine readiness,” “qualitative feedback,” “comparison to standard (in-person) care,” “privacy,” “technology,” “patient feeling,” and “patient costs.” Of the 11 domains, 26 underlying sub-domains were created. From the subdomains, a 30-question core block was proposed. The core-block together with a precursor block aimed to retrieve demographic/patient characteristics and, together with a customizable clinical outcomes block, complete the comprehensive toolkit. The toolkit, upon testing and validation, would enable researchers and system owners to assess patient-oriented aspects of audiovisual telemedicine encounters more accurately and accelerate the adoption of common audiovisual telemedicine assessment measures.