Application of mixed reality and artificial intelligence to assist medical students in learning injection technique

Abstract

Introduction: The usage of immersive technology has advanced in a number of areas of life because of the development of technology that keeps pace with the times. Another immersive technology that combines VR and AR is mixed reality (MR), which enables us to interact with 3-dimensional objects in the real world. Since MR technology gives a more nuanced experience, the market is highly promising. This study aims to evaluate the application of mixed reality and artificial intelligence to assist medical students in learning injection technique. Methods: This type of research is analytic with a quantitative and qualitative approach to prove the purpose of the research. This research involved 40 students. Due to the creative nature of immersive technology, it must be combined with other technologies to produce an even more complicated and engaging experience. In order to enhance the quality of the user experience, we will merge MR immersive technology with AI in this research for medical educational field. The integration of these two technologies via an application that can be launched on a Hololens 2 and Magic Leap 1 device and can identify person in a laboratory to support in student learning. Results: For instance, students can utilize artificial intelligence (AI) to learn the names of objects in the lab and do simulation about injection technique. The study 's outcomes are presented in software testing (FPS, CPU, GPU, and load scene) an in the form of user testing utilizing the PIECES Framework (Performance, Information and Data, Economy, Control and Security, Efficiency, and Service), which evaluates the application's utility or significance as well as the satisfaction of its users.   Conclusion: The system was able to develop a combining application of artificial intelligence and mixed reality for detecting objects in laboratories to assist learning students, according to the study's conclusions.