Deep learning‐based intraoperative video analysis for supporting surgery

Abstract

SummaryThe application of surgical tool detection and tracking and surgical phase recognition is research hotspots at present. Surgical tool detection and tracking provides accurate real‐time information to surgeons, helping them plan surgeries and get advance warnings so that procedures can be safer. Surgical phase recognition can help improve the surgery efficiency, facilitate surgeons to make correct decisions, and help evaluate surgeon skill. In this article, we described the advantages and disadvantages of applying deep learning to surgical procedures. Then, we analyzed the advantages of deep learning in visual analysis, summarized the algorithms typically used in surgical tool detection and tracking and surgical phase recognition, and reviewed the results of these algorithms. The main problems are disclosed and the development trend of deep learning‐based intraoperative video analysis for supporting surgery is briefly discussed.