Research on Lateral Ventricle Surgery Training System Based on Augmented Reality Technology
Zhu Zhaoju1,2*, Gao Chuhang1,2, Shi Jiafeng1,2, Chen Liujing1,2, He Bingwei1,2
1(School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou 350116, China) 2(Fujian Engineering Research Center of Joint Intelligent Medical Engineering, Fuzhou 350116, China)
Abstract：To address the problems of lacking image guidance, prone to forgetting, and poor training results during simulated lateral ventricle puncture experienced by medical students, this study proposed an augmented reality (AR) glasses-based lateral ventricle puncture assistance system. Based on the CT and MRI data of a patient with mild lateral ventricle enlargement, the medical modeling software Mimics was used to threshold segment the gray characteristics of various tissue structures in the skull and brain, and a 3D virtual model was constructed. Next, AR construction was performed using Vuforia SDK and Unity 3D, and a method of combining the main recognition image with the opening image was proposed to obtain an average registration error of the system of 1.333 mm. At last, the system was imported into AR glasses and debugged. Twenty clinical medical students were invited to participate and were divided into two groups: one wearing AR glasses and the other not. They performed simulated lateral ventricle frontal horn puncture operations and scored the simulated surgery using a questionnaire. The test results showed that compared with the group not wearing AR glasses, the group wearing them used an average of 4.71 minutes less time during the operation, and the success rate of puncture increased by 30%. Furthermore, the group wearing AR glasses gave significantly better feedback on the questionnaire evaluation than the control group. In conclusion, the AR glasses-based lateral ventricle puncture assistance system built in this study can significantly improve the training effect of the surgery and provide a new idea for improving the quality of lateral ventricle puncture surgery training.
朱兆聚, 高楚航, 施家峰, 陈刘晶, 何炳蔚. 基于增强现实技术的侧脑室额角穿刺训练系统研究[J]. 中国生物医学工程学报, 2024, 43(6): 673-681.
Zhu Zhaoju, Gao Chuhang, Shi Jiafeng, Chen Liujing, He Bingwei. Research on Lateral Ventricle Surgery Training System Based on Augmented Reality Technology. Chinese Journal of Biomedical Engineering, 2024, 43(6): 673-681.
[1] 张楚茜,张诗雷. 增强现实技术的研究进展及临床应用概述[J]. 组织工程与重建外科杂志, 2018, 14(1): 17-23. [2] Rolland J P, Fuchs H. Optical versus video see-through head-mounted displays in medical visualization[J]. Presence: Teleoperators and Virtual Environments, 2000, 9(3): 287-309. [3] 王宇希,张凤军,刘越. 增强现实技术研究现状及发展趋势[J]. 科技导报, 2018, 36(10): 75-83. [4] 高翔,安辉,陈为,等. 移动增强现实可视化综述[J]. 计算机辅助设计与图形学学报, 2018(1): 1-8. [5] Inoue D, Cho B, Mori M, et al. Preliminary study on the clinical application of augmented reality neuronavigation[J]. Journal of Neurological Surgery Part A: Central European Neurosurgery, 2013, 74(2): 71-76. [6] Watanabe E, Satoh M, Konno T, et al. The trans-visible navigator: a see-through neuronavigation system using augmented reality[J]. World Neurosurgery, 2016, 87: 399-405. [7] Incekara F, Smits M, Dirven C, et al. Clinical feasibility of a wearable mixed-reality device in neurosurgery[J]. World Neurosurgery, 2018, 118: e422-e427. [8] 蒋帅,霍显浩,孙美蓉,等. 增强现实技术辅助CT三维重建在经乙状窦后入路开颅手术中的应用[J]. 中华神经外科杂志, 2018, 34(6): 619-622. [9] 霍贵通,杨医通,孟祥杰,等. 增强现实技术辅助神经内镜微创手术治疗高血压脑出血[J]. 脑与神经疾病杂志, 2018, 26(264): 206-211. [10] 洪文瑶,刘宇清,何炳蔚,等. 基于虚拟现实技术的侧脑室穿刺模拟训练研究[J]. 创伤与急诊电子杂志, 2018, 6(3): 121-124. [11] Tagaytayan R, Kelemen A, Siklanyi C. Augmented reality in neurosurgery[J]. Archives of Medical Science, 2016, 14(3): 572-578. [12] 张泽树. 增强现实手术导航系统的设计与应用研究[D]. 合肥: 中国科学技术大学, 2017. [13] 孟祥军,马志庆,赵文华,等. 应用增强现实技术于医疗器械课本的研究与设计[J]. 中国医学装备, 2017, 14(9): 120-122. [14] 刘宇清,何炳蔚,庄江惠,等. 基于颅脑CT与MRI多模图像融合的3D打印模型制作及应用研究[J]. 中国实用神经疾病杂志, 2018, 21(13): 1393-1400. [15] 刘宇清,吕翱,黄绳跃,等. 计算机三维重建技术下模拟侧脑室额角穿刺方法的探讨[J]. 中华神经外科杂志, 2015, 31(3): 246-249. [16] 庄江惠,何炳蔚,刘宇清,等. 一种用于侧脑室模拟穿刺模型的研制与应用[J]. 中国医疗设备, 2018, 33(5): 32-35. [17] Guha D, Alotaibi NM, Nguyen N, et al. Augmented reality in neurosurgery: a review of current concepts and emerging applications[J]. Canadian Journal of Neurological Sciences, 2017, 44(3): 235-245. [18] Satoh M, Nakajima T, Yamaguchi T, et al.Application of augmented reality to stereotactic biopsy[J]. Neurologia Medico-chirurgica, 2019, 59(11): 444-447. [19] Watanabe E, Saton M, Konno T, et al. The trans-visible navigator: a see-through neuronavigation system using augmented reality[J]. World neurosurgery, 2016, 87: 399-405. [20] 邓薇薇. 手持式增强现实神经导航关键技术研究及其系统建立[D]. 上海: 复旦大学, 2014. [21] Deng Weiwei, Li Fang, Wang Manning, et al. Easy-to-use augmented reality neuronavigation using a wireless tablet PC[J]. Stereotactic and Functional Neurosurgery, 2014, 92(1): 17-24. [22] Lu Shang, Perdomo Y, Jiang Xianta, et al. Integrating eye-tracking to augmented reality system for surgical training[J]. Journal of Medical Systems, 2020, 44(11): 192-198.
