Measuring Stakeholder Perceptions: A Review of Social Validity Reporting in ASHA Journals

Abstract

Purpose Intervention research in speech-language pathology is growing; however, there remains a gap between research and clinical practice. To promote evidence-based practice, stakeholder input may be solicited during the development and evaluation of treatments. One method of evaluating stakeholder input is by subjectively measuring social validity. Social validity probes end users' satisfaction and acceptability of a treatment. Method This review article explores the type and frequency of subjective social validity measures reported in speech-language pathology treatment literature published in American Journal of Speech-Language Pathology; Journal of Speech, Language, and Hearing Research; and Language, Speech, and Hearing Services in Schools from January 2017 through April 2019. In total, 93 treatment studies were included and coded descriptively. Results Of the 93 treatment studies included in this review, 20 reported subjective measures of social validity. The most common method of measurement was questionnaires ( n = 19), followed by interviews ( n = 5), and direct observation ( n = 1). Conclusions Only 21.5% of reviewed speech-language pathology treatment articles from American Speech-Language-Hearing Association journals reported measures of social validity, although it is a crucial component of implementation of evidence-based practice. We urge researchers and journal editors to include social validity measures in treatment literature as we promote the uptake of evidence-based practices and the involvement of stakeholders during the development of evidence-based practices. We also encourage the development of social validity measures that can be validated on individuals with communication disorders.