Adversity and Turnaround in Medical Education:Development and vision of a framework for a multimodal teaching and learning interaction model

Abstract

Abstract Background Post-pandemic era has provided an opportunity for new educational theory as long as the new way to make use of technology. This paper puts forward the architecture of the multimodal teaching interaction model and the prospect of application situations combining the research foundations of technological phenomenology and multimodal theory. Objective This paper aims to clarify a multimodal teaching interaction model perspective, we hope the interactive feedback between medical education subjects can be improved, meet the teaching and learning needs in the post-epidemic era, and promote the development of medical education reform. The focal point is the characteristics, structure, and application of MTIM. Method Using the behavioral education model, situational learning, and human-computer interaction theory as the theoretical framework, we take the medical teaching model as the background, combined with cutting-edge virtual reality, haptic feedback, gesture interaction, and other technologies, rely on the multi-level application architecture such as physical layer and perceptual feedback layer, to successfully build a teaching method of multimodal virtual experience and the overall conceptual framework of learning scenarios. Results This is an innovative conceptual model that focuses on the fundamentals of the overall framework. The characteristics of the model have obvious application advantages in three types of virtual medical education scenarios: "Theoretical knowledge learning", "Operational skill learning" and "Practical experiential learning". And through the characteristics of model immersion, collaboration, dynamic feedback, and other characteristics, the cross-spatial connection between virtual and real is established, which greatly breaks through the limitations of space scenes. Conclusion The multimodal teaching interaction model(MTIM) broadens the application scenarios of teaching, effectively enhances the sense of reality and experience of situational teaching, has great application prospects for promoting the development of medical education reform, and provides some feasible ideas and suggestions for the future development of artificial intelligence in medical education.