Designing a New Endoscope for Panoramic-View with Focus-Area 3D-Vision in Minimally Invasive Surgery
-
Published:2019-12-03
Issue:2
Volume:40
Page:204-219
-
ISSN:1609-0985
-
Container-title:Journal of Medical and Biological Engineering
-
language:en
-
Short-container-title:J. Med. Biol. Eng.
Author:
Kim Dinh ThaiORCID, Cheng Ching-Hwa, Liu Don-Gey, Liu Kai Che Jack, Huang Wayne Shih Wei
Abstract
Abstract
Purpose
The minimally invasive surgery (MIS) has shown advantages when compared to traditional surgery. However, there are two major challenges in the MIS technique: the limited field of view (FOV) and the lack of depth perception provided by the standard monocular endoscope. Therefore, in this study, we proposed a New Endoscope for Panoramic-View with Focus-Area 3D-Vision (3DMISPE) in order to provide surgeons with a broad view field and 3D images in the surgical area for real-time display.
Method
The proposed system consisted of two endoscopic cameras fixed to each other. Compared to our previous study, the proposed algorithm for the stitching videos was novel. This proposed stitching algorithm was based on the stereo vision synthesis theory. Thus, this new method can support 3D reconstruction and image stitching at the same time. Moreover, our approach employed the same functions on reconstructing 3D surface images by calculating the overlap region’s disparity and performing image stitching with the two-view images from both the cameras.
Results
The experimental results demonstrated that the proposed method can combine two endoscope’s FOV into one wider FOV. In addition, the part in the overlap region could also be synthesized for a 3D display to provide more information about depth and distance, with an error of about 1 mm. In the proposed system, the performance could achieve a frame rate of up to 11.3 fps on a single Intel i5-4590 CPU computer and 17.6 fps on a computer with an additional GTX1060 Nvidia GeForce GPU. Furthermore, the proposed stitching method in this study could be made 1.4 times after when compared to that in our previous report. Besides, our method also improved stitched image quality by significantly reducing the alignment errors or “ghosting” when compared to the SURF-based stitching method employed in our previous study.
Conclusion
The proposed system can provide a more efficient way for the doctors with a broad area of view while still providing a 3D surface image in real-time applications. Our system give promises to improve existing limitations in laparoscopic surgery such as the limited FOV and the lack of depth perception.
Funder
Ministry of Science and Technology (MOST) of Taiwan, Rep. of China
Publisher
Springer Science and Business Media LLC
Subject
Biomedical Engineering,General Medicine
Reference41 articles.
1. Sinha, R. Y., Raje, S. R., & Rao, G. A. (2017). Three-dimensional laparoscopy: Principles and practice. Journal of Minimal Access Surgery,13(3), 165–169. 2. Huang, X., Abdalbari, A., & Ren, J. (2013). 3D surface reconstruction of stereo endoscopic images for minimally invasive surgery. Biomedical Engineering Letters,3(3), 149–157. 3. Lurie, K. L., Angst, R., Zlatev, D. V., Liao, J. C., & Ellerbee Bowden, A. K. (2017). 3D reconstruction of cystoscopy videos for comprehensive bladder records. Biomedical Optics Express,8(4), 2106–2123. 4. Penza, V., Ortiz, J., Mattos, L. S., Forgione, A., & De Momi, E. (2016). Dense soft tissue 3D reconstruction refined with super-pixel segmentation for robotic abdominal surgery. International Journal of Computer Assisted Radiology and Surgery,11(2), 197–206. 5. Schoob, A., Kundrat, D., Kahrs, L. A., & Ortmaier, T. (2016). Comparative study on surface reconstruction accuracy of stereo imaging devices for microsurgery. International Journal of Computer Assisted Radiology and Surgery,11(1), 145–156.
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|