Missed opportunities in mixed methods EdTech research? Visual joint display development as an analytical strategy for achieving integration in mixed methods studies

Abstract

AbstractMixed methods research is becoming more prevalent in educational technology due to its potential for addressing complex educational problems by integrating qualitative and quantitative data and findings. At the same time, a growing chorus of researchers laments the quality and rigor of research in this field. Mixed methods studies which demonstrate explicit integration in educational technology research are scarce, and even fewer apply integration strategies recommended in the literature, such as visual joint displays. Failure to address the challenge of comprehensive integration may result in missed opportunities for deeper insights. To address this methodological problem, the purpose of this paper is to shed light on the procedures, opportunities, and practical challenges associated with mixed methods integration through the use of visual joint displays as an analytical tool for data interpretation and reporting in these types of designs. Using an exploratory sequential mixed methods multiple case study design as an illustrative example, we will (1) provide step-by-step guidance on how to develop a visual joint display to conduct an integrated analysis in a complex mixed methods design; (2) demonstrate how to use a display of this type to integrate meta-inferences previously generated through a series of interconnected joint displays; and (3) illustrate the benefits of integrating at the literature review, theoretical, analysis, interpretation, and reporting levels in mixed methods studies. This methodological article aims to advance knowledge in educational technology research by addressing the integration challenge in mixed methods studies and assisting researchers in this field in achieving comprehensive integration at multiple levels.