Keywords
Deep learning
Robotic surgery
Robot-assisted surgery
da Vinci System
Conceptual framework
Decision support system
How to Cite
Abstract
This study proposes a conceptual framework for integrating deep learning into the da Vinci Surgical System. The framework was developed after identifying common applications and challenges through a systematic review. It combines multiple data types, including visual, kinematic, and physiological signals, into a closed-loop system. This system includes four core components: data acquisition and fusion, deep learning-based analysis, adaptive control and feedback, and continuous skill assessment. These components interact to support real-time surgical guidance and personalized training, aiming to improve surgical outcomes. To inform the framework, a systematic search of the PubMed database was conducted, focusing on studies that combine deep learning with the da Vinci system. Two major application areas were identified: the first involves autonomous or semi-autonomous instrument control and image-guided navigation, and the second covers surgical skill assessment and workflow analysis. While existing studies demonstrate the potential of artificial intelligence in robotic surgery, they also reveal technical and practical limitations. By analyzing these common approaches and obstacles, this study provides a structured foundation for future research. The proposed framework offers a unified view that connects data processing, intelligent decision-making, and feedback, paving the way for smarter systems that assist both in real-time procedures and long-term training, and helping bridge the gap between advanced robotic hardware and cognitive support in surgical environments.
References
Amparore, D., M. Sica, P. Verri, F. Piramide, E. Checcucci, et al., 2024. Computer vision and machine-learning techniques for automatic 3D virtual images overlapping during augmented reality guided robotic partial nephrectomy. Technology in Cancer Research & Treatment, 23: 15330338241229368.
Attanasio, A., B. Scaglioni, M. Leonetti, A. F. Frangi, W. Cross, et al., 2020. Autonomous tissue retraction in robotic assisted minimally invasive surgery – A feasibility study. IEEE Robotics and Automation Letters, 5: 6528–6535.
Azizian, M., M. Liu, I. Khalaji, J. Sorger, D. Oh, et al., 2020. The da Vinci surgical system. In Handbook of Robotic and Image-Guided Surgery, pp. 39–55, Elsevier.
Boal, M. W. E., D. Anastasiou, F. Tesfai, W. Ghamrawi, E. Mazomenos, et al., 2024. Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: A systematic review. British Journal of Surgery, 111: znad331.
Brown, J. D. and K. J. Kuchenbecker, 2023. Effects of automated skill assessment on robotic surgery training. The International Journal of Medical Robotics and Computer Assisted Surgery, 19: e2492.
Cannizzaro, D., M. Scalise, C. Zancanella, S. Paulli, S. Peron, et al., 2024. Comparative evaluation of major robotic systems in microanastomosis procedures: A systematic review of current capabilities and future potential. Brain Sciences, 14: 1235.
Celotto, F., N. Ramacciotti, A. Mangano, G. Danieli, F. Pinto, et al., 2024. Da Vinci single-port robotic system current application and future perspective in general surgery: A scoping review. Surgical Endoscopy, 38: 4814–4830.
Cepolina, F. and R. P. Razzoli, 2022. An introductory review of robotically assisted surgical systems. The International Journal of Medical Robotics and Computer Assisted Surgery, 18: e2409.
Dean Pelegrina, G. and S. Siraj, 2024. Shapley value-based approaches to explain the quality of predictions by classifiers. IEEE Transactions on Artificial Intelligence, 5: 4217–4231.
D’Ettorre, C., A. Mariani, A. Stilli, F. Rodriguez Y Baena, P. Valdastri, et al., 2021. Accelerating surgical robotics research: A review of 10 years with the da Vinci research kit. IEEE Robotics & Automation Magazine, 28: 56–78.
DiMaio, S., M. Hanuschik, and U. Kreaden, 2011. The da Vinci Surgical System. In Surgical Robotics, edited by J. Rosen, B. Hannaford, and R. M. Satava, pp. 199–217, Springer US, Boston, MA.
Egert, M., J. E. Steward, and C. P. Sundaram, 2020. Machine learning and artificial intelligence in surgical fields. Indian Journal of Surgical Oncology, 11: 573–577.
Gonzalez, G. T., U. Kaur, M. Rahman, V. Venkatesh, N. Sanchez, et al., 2021. From the dexterous surgical skill to the battlefield—A robotics exploratory study. Military Medicine, 186: 288–294.
Hashemi, N., M. B. S. Svendsen, F. Bjerrum, S. Rasmussen, M. G. Tolsgaard, et al., 2023. Acquisition and usage of robotic surgical data for machine learning analysis. Surgical Endoscopy, 37: 6588–6601.
Hatcher, A. J., B. T. Beneville, and M. M. Awad, 2025. The evolution of surgical skills simulation education: Robotic skills. Surgery, 181: 109173.
Huber, M., S. Ourselin, C. Bergeles, and T. Vercauteren, 2022. Deep homography estimation in dynamic surgical scenes for laparoscopic camera motion extraction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 10: 321–329.
Iftikhar, M., M. Saqib, M. Zareen, and H. Mumtaz, 2024. Artificial intelligence: Revolutionizing robotic surgery – Review. Annals of Medicine & Surgery, 86: 5401–5409.
Khan, A., H. Yang, D. R. S. Habib, D. Ali, and J. Y. Wu, 2025. Development of a machine learning-based tension measurement method in robotic surgery. Surgical Endoscopy.
Kinoshita, T., R. Sato, E. Akimoto, Y. Tanaka, T. Okayama, et al., 2022. Reduction in postoperative complications by robotic surgery: A case–control study of robotic versus conventional laparoscopic surgery for gastric cancer. Surgical Endoscopy, 36: 1989–1998.
Knudsen, J. E., U. Ghaffar, R. Ma, and A. J. Hung, 2024. Clinical applications of artificial intelligence in robotic surgery. Journal of Robotic Surgery, 18: 102.
Koh, D. H., W. S. Jang, J. W. Park, W. S. Ham, W. K. Han, et al., 2018. Efficacy and safety of robotic procedures performed using the da Vinci robotic surgical system at a single institute in Korea: Experience with 10000 cases. Yonsei Medical Journal, 59: 975.
Koukourikis, P. and K. H. Rha, 2021. Robotic surgical systems in urology: What is currently available? Investigative and Clinical Urology, 62: 14.
Li, J., X. Gong, P. Li, L. Xiao, X. Chang, et al., 2022. Application of Da Vinci robotic surgery system in cervical cancer: A single institution experience of 557 cases. Asian Journal of Surgery, 45: 707–711.
Li, T., W. Zhu, W. Xia, L. Wang, W. Li, et al., 2024. Research on adverse event classification algorithm of da Vinci surgical robot based on BERT-BiLSTM model. Frontiers in Computational Neuroscience, 18: 1476164.
Lyman, W. B., M. J. Passeri, K. Murphy, I. A. Siddiqui, A. S. Khan, et al., 2021. An objective approach to evaluate novice robotic surgeons using a combination of kinematics and stepwise cumulative sum (CUSUM) analyses. Surgical Endoscopy, 35: 2765–2772.
Marcus, H. J., P. T. Ramirez, D. Z. Khan, H. Layard Horsfall, J. G. Hanrahan, et al., 2024. The IDEAL framework for surgical robotics: Development, comparative evaluation and long-term monitoring. Nature Medicine, 30: 61–75.
Page, M. J., J. E. McKenzie, P. M. Bossuyt, I. Boutron, T. C. Hoffmann, et al., 2021. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, p. n71.
Panesar, S., Y. Cagle, D. Chander, J. Morey, J. Fernandez-Miranda, et al., 2019. Artificial intelligence and the future of surgical robotics. Annals of Surgery, 270: 223–226.
Pugin, F., P. Bucher, and P. Morel, 2011. History of robotic surgery: From AESOP® and ZEUS® to da Vinci®. Journal of Visceral Surgery, 148: e3–e8.
Reddy, K., P. Gharde, H. Tayade, M. Patil, L. S. Reddy, et al., 2023. Advancements in robotic surgery: A comprehensive overview of current utilizations and upcoming frontiers. Cureus.
Rivero-Moreno, Y., S. Echevarria, C. Vidal-Valderrama, L. Stefano-Pianetti, J. Cordova-Guilarte, et al., 2023. Robotic surgery: A comprehensive review of the literature and current trends. Cureus.
Saman, A., 2024. Next-gen surgery: AI robots leading the way in healthcare. Archives of Community Medicine and Public Health, 10: 013–017.
Setchi, R., M. B. Dehkordi, and J. S. Khan, 2020. Explainable robotics in human-robot interactions. Procedia Computer Science, 176: 3057–3066.
Shafiei, S. B., S. Shadpour, and J. L. Mohler, 2024a. An integrated electroencephalography and eye-tracking analysis using eXtreme Gradient Boosting for mental workload evaluation in surgery. Human Factors: The Journal of the Human Factors and Ergonomics Society, p. 00187208241285513.
Shafiei, S. B., S. Shadpour, J. L. Mohler, K. Attwood, Q. Liu, et al., 2023a. Developing surgical skill level classification model using visual metrics and a gradient boosting algorithm. Annals of Surgery Open, 4: e292.
Shafiei, S. B., S. Shadpour, J. L. Mohler, P. Rashidi, M. S. Toussi, et al., 2024b. Prediction of Robotic Anastomosis Competency Evaluation (RACE) metrics during vesico-urethral anastomosis using electroencephalography, eye-tracking, and machine learning. Scientific Reports, 14: 14611.
Shafiei, S. B., S. Shadpour, J. L. Mohler, F. Sasangohar, C. Gutierrez, et al., 2023b. Surgical skill level classification model development using EEG and eye-gaze data and machine learning algorithms. Journal of Robotic Surgery, 17: 2963–2971.
Steffens, D., K. E. McBride, N. Hirst, M. J. Solomon, T. Anderson, et al., 2023. Surgical outcomes and cost analysis of a multispecialty robotic-assisted surgery caseload in the Australian public health system. Journal of Robotic Surgery, 17: 2237–2245.
Takács, K., E. Lukács, R. Levendovics, D. Pekli, A. Szijártó, et al., 2024. Assessment of surgeons’ stress levels with digital sensors during robot-assisted surgery: An experimental study. Sensors, 24: 2915.
Ullah, Z., S. Roy, S. Muhammad, C. Yu, H. Huang, et al., 2024. Fluorescence imaging-guided surgery: Current status and future directions. Biomaterials Science, 12: 3765–3804.
Wu, J. Y., P. Kazanzides, and M. Unberath, 2020. Leveraging vision and kinematics data to improve realism of biomechanic soft tissue simulation for robotic surgery. International Journal of Computer Assisted Radiology and Surgery, 15: 811–818.
Yilmaz, N., B. Burkhart, A. Deguet, P. Kazanzides, and U. Tumerdem, 2024. Enhancing robotic telesurgery with sensorless haptic feedback. International Journal of Computer Assisted Radiology and Surgery, 19: 1147–1155.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.