Use of AR / VR in Micro Manipulation Support System for Recognition of Monocular Microscopic Images

Abstract

This study researches the use of Augmented Reality / Virtual Reality (AR / VR) in an affordable and highly flexible micro manipulation system for the recognition of microscopic images, images that support microscopic manipulation in the interface between the manipulation space and the operator. The application of AR / VR usually requires sensing of the manipulation space with more than one microscope or sensor, not only making the system more complex and costly but also making the manipulation space under the microscope smaller. In this research, therefore, we use the background finite-difference method with background models for monocular microscopic images of the manipulation space; we can build up information needed formanipulation support with AR / VR while removing the effects of any disturbance to the recognition of the manipulation space. We also use liquid bridging forces for the manipulations. The experimental results confirmthat the information processing of the image processing method used in this research is adequate in both terms of accuracy and time efficiency to support microscopic manipulation using liquid bridging forces.