Development of the Teaching Interpersonal Skills for Telehealth Checklist

Abstract

While interpersonal skills in telehealth may positively impact clinical practice, patient engagement and outcomes, assessment strategies are lacking. We conducted a multi-stage iterative approach to develop and test validity and reliability of the Teaching Interpersonal Skills in Telehealth checklist (TIPS-TC). First, we identified observable communication behaviors from the literature. Second, we surveyed telehealth managers and researchers (N = 11) to rate appropriateness of potential checklist items. Level of agreement (35%–91%) and Kappa statistic (0.18–0.89) confirmed items to be retained and identified items to modify. Based on response patterns and comments, we reduced 44 items to 12 critical checklist behaviors. Third, student clinicians used the checklist with video telehealth consultations and provided feedback. Fourth, we conducted reliability testing with practitioners and administrators (N = 68) who completed the TIPS-TC for two versions of a telehealth scenario. Strong interrater reliability intraclass correlation coefficient (ICC) and test-retest reliability ICC (both p < .001), along with non-significant findings of order effects supported the checklist as an acceptable instrument to differentiate high skill from low skill telehealth sessions. The TIPS-TC offers an evidence-based approach to assessing interpersonal skills in telehealth to help evaluate clinician competence and tailor learning activities across disciplinary roles.