Predictive Model for Nasopharyngeal Carcinoma Recurrence with MRI and Optimized 3D-ResNet18
Li Jiongyi1, Li Bin1*, Qiu Qianhui2*, Liu Yibin2, Tian Lianfang1
1(School of Automation Science and Engineering, South China University of Technology, Guangzhou 510640, China) 2(Department of Otolaryngology & Head and Neck Surgery, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou 510080, China)
Abstract:Recurrence of nasopharyngeal carcinoma (NPC) after treatment is an important factor of treatment failure, which is extremely harmful to the quality of life, cure rate and even survival rate of patients with NPC. Therefore, effective prediction of nasopharyngeal carcinoma recurrence plays crucial roles in the prognosis of NPC. Magnetic resonance imaging (MRI) has high resolution of soft tissue, which is a preferred inspection method of NPC. Each imaging of NPC in MRI is quite different, and the gray level of lesion tissue is uneven and the boundaries are blurred, which cause the fact that manual segmentation is difficult, costly, and has limited accuracy, while automatic segmentation of NPC lesions in MRI has low accuracy rate. As a result, low-level image feature extraction and computation based on NPC lesion segmentation has low accuracy rate as well. Performance of NPC recurrence prediction model with radiomics feature engineering and traditional machine learning methods is poor. To solve this problem, a nasopharyngeal carcinoma recurrence prediction model was proposed with MRI and Nesterov accelerating gradient optimized 3D-ResNet18. Through the automatic detection of NPC lesion by distance regularized level-set evolution and histogram equalization in MRI, the enhanced imaging data without redundancy was automatically obtained. The improved 3D-ResNet18 network model optimized by Nesterov accelerated gradient algorithm was used to extract the deep features of NPC and achieve recurrence prediction, providing guidance on the patients’ treatment plans. The research was conducted on MRI images of 140 patients with NPC to complete the model training and cross-validation analysis. Recurrence of NPC was predicted with sensitivity, specificity, accuracy, and AUC of 80.0%, 64.6%, 72.3% and 0.75 respectively. The p values of paired t-test comparing 3D-ResNet10 model and Momentum optimization method under the same conditions were 0.040 and 0.006 respectively. The results showed that the predictive model of nasopharyngeal carcinoma recurrence with improved 3D-ResNet18 can effectively predict the nasopharyngeal carcinoma recurrence.
李炯逸, 李彬, 邱前辉, 刘遗斌, 田联房. 基于MRI与优化3D-ResNet18的鼻咽癌复发预测模型[J]. 中国生物医学工程学报, 2023, 42(5): 583-593.
Li Jiongyi, Li Bin, Qiu Qianhui, Liu Yibin, Tian Lianfang. Predictive Model for Nasopharyngeal Carcinoma Recurrence with MRI and Optimized 3D-ResNet18. Chinese Journal of Biomedical Engineering, 2023, 42(5): 583-593.
[1] Sung H, Ferlay J, Siegel RL, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA: A Cancer Journal for Clinicians, 2021, 71(3): 209-249. [2] Ouyang PY, Su Z, Mao YP, et al. Prognostic impact of family history in southern Chinese patients with undifferentiated nasopharyngeal carcinoma[J]. British Journal of Cancer, 2013, 109(3): 788-794. [3] Chua MLK, Wee JTS, Hui EP, et al. Nasopharyngeal carcinoma[J]. The Lancet, 2016, 387(10022): 1012-1024. [4] Au KH, Ngan RKC, Ng AWY, et al. Treatment outcomes of nasopharyngeal carcinoma in modern era after intensity modulated radiotherapy (IMRT) in Hong Kong: a report of 3328 patients (HKNPCSG 1301 study)[J]. Oral Oncology, 2018, 77: 16-21. [5] Lee AWM, Ng WT, Chan JYW, et al. Management of locally recurrent nasopharyngeal carcinoma[J]. Cancer treatment reviews, 2019, 79: 101890. [6] Su Shengfa, Han Fei, Zhao Chong, et al. Treatment outcomes for different subgroups of nasopharyngeal carcinoma patients treated with intensity-modulated radiation therapy[J]. Chinese Journal of Cancer, 2011, 30(8): 565-573. [7] Raghavan Nair JK, Vallières M, Mascarella MA, et al. Magnetic resonance imaging texture analysis predicts recurrence in patients with nasopharyngeal carcinoma[J]. Canadian Association of Radiologists Journal, 2019, 70(4): 394-402. [8] Peng Lihong, Hong Xiaotong, Yuan Qingyu, et al. Prediction of local recurrence and distant metastasis using radiomics analysis of pretreatment nasopharyngeal [18F]FDG PET/CT images[J]. Annals of Nuclear Medicine, 2021, 35(4): 458-468. [9] Kumdee O, Bhongmakapat T, Ritthipravat P. Prediction of nasopharyngeal carcinoma recurrence by neuro-fuzzy techniques[J]. Fuzzy Sets and Systems, 2012, 203: 95-111. [10] Liu Jia, Mao Yu, Li Zhenjiang, et al. Use of texture analysis based on contrast‐enhanced MRI to predict treatment response to chemoradiotherapy in nasopharyngeal carcinoma[J]. Journal of Magnetic Resonance Imaging, 2016, 44(2): 445-455. [11] Akram F, Koh PE, Wang Fuqiang, et al. Exploring MRI based radiomics analysis of intratumoral spatial heterogeneity in locally advanced nasopharyngeal carcinoma treated with intensity modulated radiotherapy[J]. PLoS ONE, 2020, 15(10): e240043. [12] Zhang Lulu, Huang Mengyao, Li Yan, et al. Pretreatment MRI radiomics analysis allows for reliable prediction of local recurrence in non-metastatic T4 nasopharyngeal carcinoma[J]. EBioMedicine, 2019, 42: 270-280. [13] Lakshmanaprabu SK, Mohanty SN, Shankar K, et al. Optimal deep learning model for classification of lung cancer on CT images[J]. Future Generation Computer Systems, 2019, 92: 374-382. [14] He Tiancheng, Fong JN, Moore LW, et al. An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer[J]. Computerized Medical Imaging and Graphics, 2021, 89: 101894. [15] Mzoughi H, Njeh I, Wali A, et al. Deep multi-scale 3D convolutional neural network (CNN) for MRI gliomas brain tumor classification[J]. Journal of Digital Imaging, 2020, 33: 903-915. [16] Feng Wei, Halm-Lutterodt NV, Tang Hao, et al. Automated MRI-based deep learning model for detection of Alzheimer’s disease process[J]. International Journal of Neural Systems, 2020, 30(6): 2050032. [17] Lee JJ, Yang H, Franc BL, et al. Deep learning detection of prostate cancer recurrence with 18F-FACBC (fluciclovine, Axumin®) positron emission tomography[J]. European Journal of Nuclear Medicine and Molecular Imaging, 2020, 47(13): 2992-2997. [18] Wang Hanyin, Li Yikuan, Khan SA, et al. Prediction of breast cancer distant recurrence using natural language processing and knowledge-guided convolutional neural network[J]. Artificial Intelligence in Medicine, 2020, 110: 101977. [19] Lu Zhenyu, Bai Yanzhong, Chen Yi, et al. The classification of gliomas based on a Pyramid dilated convolution resnet model[J]. Pattern Recognition Letters, 2020, 133: 173-179. [20] Loey M, Manogaran G, Taha MHN, et al. Fighting against COVID-19: a novel deep learning model based on YOLO-v2 with ResNet-50 for medical face mask detection[J]. Sustainable Cities and Society, 2021, 65: 102600. [21] Mohammed MA, Abd Ghani MK, Hamed RI, et al. Review on nasopharyngeal carcinoma: concepts, methods of analysis, segmentation, classification, prediction and impact: a review of the research literature[J]. Journal of Computational Science, 2017, 21: 283-298. [22] Li Chunming, Xu Chenyang, Gui Changfeng, et al. Distance regularized level set evolution and its application to image segmentation[J]. IEEE Transactions on Image Processing, 2010, 19(12): 3243-3254. [23] Li Chunming, Kao CY, Gore JC, et al. Minimization of region-scalable fitting energy for image segmentation[J]. IEEE Transactions on Image Processing, 2008, 17(10): 1940-1949. [24] 陈侃,李彬,田联房. 基于模糊速度函数的活动轮廓模型的肺结节分割[J]. 自动化学报, 2013, 39(8): 1257-1264. [25] He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas:IEEE, 2016: 770-778. [26] Szegedy C, Ioffe S, Vanhoucke V, et al. Inception-v4, inception-resnet and the impact of residual connections on learning[C]//Proceedings of the AAAI Conference on Artificial Intelligence. San Francisco:IEEE, 2017, 31(1): 4278-4284. [27] Xie Saining, Girshick R, Dollár P, et al. Aggregated residual transformations for deep neural networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu:IEEE, 2017: 1492-1500. [28] He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Delving deep into rectifiers: surpassing human-level performance on imagenet classification[C]//Proceedings of the IEEE International Conference on Computer Vision. Santiago:IEEE, 2015: 1026-1034. [29] Sutskever I, Martens J, Dahl G, et al. On the importance of initialization and momentum in deep learning[C]//International Conference on Machine Learning. Atlanta: IEEE, 2013: 1139-1147.