Exploring design considerations for multimodal learning analytics systems: an interview study

Abstract

Multimodal Learning Analytics (MMLA) systems integrate diverse data to provide real-time insights into student learning, yet their design faces the challenge of limited established guidelines. This study investigates essential design considerations for MMLA systems during the research and development phase, aiming to enhance their effectiveness in educational settings. A qualitative approach employing semi-structured interviews was conducted with a diverse group of researchers in the MMLA field. Deductive and thematic analysis were used to identify key design considerations, including technology integration, constraints and learning scenarios. The analysis further revealed intersections between various design considerations, both confirming existing themes and highlighting new emergent ones. Based on the findings, the MMLA Design Framework (MDF) was developed to provide a structured approach to guide the design and development of MMLA systems. This framework, along with the identified design considerations, addresses the lack of conventional practices in MMLA design and offers practical insights for practitioners and researchers. The results of this study have the potential to significantly impact both research and educational applications of MMLA systems, paving the way for more effective and informed designs.