Barriers and considerations in the design and implementation of digital behavioral interventions: A qualitative analysis (Preprint)

Abstract

Digital behavioral interventions have become increasingly popular for their ability to support patient diagnosis and treatment, chronic disease self-management, behavior change, and/or adherence to recommended care. However, digital intervention development is impeded by challenges such as limited technical skill, limited access to developers, and cost. The purpose of this study was to elicit in-depth qualitative feedback from intervention developers who have interests in digital behavioral interventions but lack programming skills regarding the barriers they experience and key considerations that go into the design and implementation of digital interventions.

To understand barriers to the design and implementation of digital behavioral interventions, as well as to identify key considerations for researchers who are developing these interventions.

We conducted semi-structured qualitative interviews with 18 researchers who had experience either designing (but not coding) digital behavioral interventions or running research studies with them. Participants were a convenience sample of users of the Computerized Intervention Authoring System (CIAS) platform, an existing no-code development platform for building digital intervention content, and were recruited through either direct email solicitation or snowball sampling. All interviews were conducted and recorded over videoconference between February and April 2020. Recordings from interviews were transcribed and thematically analyzed by multiple coders.

Interviews were completed with 18 participants and lasted between 24-65 minutes (mean = 46.9 minutes; SD = 11.3 minutes). Interviewees were predominantly female (94.4%; 17/18) and represented different job roles ranging from researcher to project/study staff. Three key barriers to the development of digital behavior interventions were identified during interviews: lack of cross-disciplinary understanding; variability in recipients’ technology access, infrastructure, and literacy; and the idea that evidence-based in-person interactions do not translate directly to digital interactions. Interviewees identified several key considerations that interventionists learned to prioritize, which have the potential to overcome these barriers and lead to successful interventions.

Barriers to the development of digital behavioral interventions are often created by a lack of cross-disciplinary understanding, which can lead to difficulties conceptualizing interventions, unrealistic expectations in terms of cost, and confusion about the development process. Moreover, concerns about research study participant characteristics and access to technology, as well as the translation of in-person interventions to digital are apparent. Appropriate training in how to work with software development teams may help future digital behavior intervention creators overcome these barriers and may lead to new, exciting innovations in this space.