Expediting the Analysis of Qualitative Data in Evaluation

Abstract

Qualitative data offer advantages to evaluators, including rich information about stakeholders’ perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators’ needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and assessment methods by proposing procedures that evaluators can use to expedite the coding and analysis of qualitative data and comparing these procedures to other possible methods. Specifically, we outline procedures for the rapid identification of themes from audio recordings, which allow evaluators to code and analyze qualitative data without time-consuming transcription. We illustrate the use and assess the reliability of these procedures using qualitative semi-structured interview data from 18 public school administrators on how they locate information about and decide to use instructional, health, and social skills programming in their districts. Finally, we end with advantages and trade-offs of these procedures as well as recommendations for how to apply them.