Abstract：Neoadjuvant chemotherapy is helpful to improve the later survival rate of breast cancer patients, but the efficacy evaluation has a certain lag. Accurate evaluation of the efficacy of neoadjuvant chemotherapy can give medical doctors more effective clinical suggestions and implement more optimized treatment plans. In order to make better use of the spatial information of the image and the time series information of the enhanced image, a dynamic enhanced image mapping pattern map was proposed to predict the efficacy of neoadjuvant chemotherapy for breast cancer. The images of 208 patients with breast cancer before neoadjuvant chemotherapy were retrospectively collected. According to the Miller & Payne grading system, the data were labeled as response group and non-response group, and randomly divided into training set (126 cases) and test set (82 cases). After image preprocessing and segmentation of the region of interest, the maximum diameter of the tumor and its adjacent 7 slices were selected to construct the mapping mode map. The original slice image, multi-sequence images under different mapping modes and multi-sequence images under fusion two mapping modes were constructed by combining the enhanced time series. The deep learning network was used to predict the mapping pattern graph, the ROC curve of the prediction results was drawn, and the evaluation indicators such as AUC, sensitivity, specificity were calculated to evaluate the performance of the model type. Among them, the prediction model of multi-sequence images fused with two mapping modes achieved the best result, with an AUC of 0.832. Experimental results showed that compared with the original slice images, the method combining longitudinal time series images and spatial features between slices effectively improved the classification effect of neoadjuvant chemotherapy response prediction.
刘鑫, 范明, 厉力华. 动态增强影像映射图的深度学习方法预测乳腺癌新辅助化疗疗效[J]. 中国生物医学工程学报, 2023, 42(6): 710-719.
Liu Xin, Fan Ming, Li Lihua. Deep Learning Model Using DCE-MRI Mapping for Prediction of Response to NeoadjuvantChemotherapy in Breast Cancer. Chinese Journal of Biomedical Engineering, 2023, 42(6): 710-719.
[1] Siegel RL, Miller KD, Fuchs HE, et al. Cancer statistics, 2022[J]. CA Cancer J Clin, 2022, 72(1): 7-33. [2] Sung H, Ferlay J, Siegel RL, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA Cancer J Clin, 2021, 71(3): 209-249. [3] Kaufmann M, Von Minckwitz G, Mamounas EP, et al. Recommendations from an international consensus conference on the current status and future of neoadjuvant systemic therapy in primary breast cancer[J]. Annals of surgical oncology, 2012, 19(5): 1508-1516. [4] Dialani V, Chadashvili T, Slanetz PJ. Role of imaging in neoadjuvant therapy for breast cancer[J]. Annals of Surgical Oncology, 2015, 22(5): 1416-1424. [5] García-Martínez E, Gil GL, Benito AC, et al. Tumor-infiltrating immune cell profiles and their change after neoadjuvant chemotherapy predict response and prognosis of breast cancer[J]. Breast cancer research, 2014, 16(6): 1-17. [6] Mougalian SS, Soulos PR, Killelea BK, et al. Use of neoadjuvant chemotherapy for patients with stage I to III breast cancer in the United States[J]. Cancer, 2015, 121(15): 2544-2552. [7] Cortazar P, Zhang L, Untch M, et al. Pathological complete response and long-term clinical benefit in breast cancer: the CTNeoBC pooled analysis[J]. The Lancet, 2014, 384(9938): 164-172. [8] 《乳腺癌新辅助治疗的病理诊断专家共识(版)》编写组.乳腺癌新辅助治疗的病理诊断专家共识(2020版)[J].中华病理学杂志,2020,49(4):296-304. [9] 孙哲,李艳翠.常用影像学检查方法在乳腺癌诊断中的应用及进展[J].中国现代医生,2022,60(5):192-196. [10] Bhooshan N, Giger ML, Jansen SA, et al. Cancerous breast lesions on dynamic contrast-enhanced MR images: computerized characterization for image-based prognostic markers[J]. Radiology, 2010, 254(3): 680-690. [11] 汪晓红,李瑞敏,彭卫军.磁共振功能成像在乳腺癌新辅助化疗早期疗效评价中的应用[J].磁共振成像,2011,2(3):172-176. [12] Drisis S, Metens T, Ignatiadis M, et al. Quantitative DCE-MRI for prediction of pathological complete response following neoadjuvant treatment for locally advanced breast cancer: the impact of breast cancer subtypes on the diagnostic accuracy[J]. European radiology, 2016, 26(5): 1474-1484. [13] Peng S, Chen L, Tao J, et al. Radiomics analysis of multi-phase DCE-MRI in predicting tumor response to neoadjuvant therapy in breast cancer[J]. Diagnostics, 2021, 11(11): 2086. [14] Jahani N, Cohen E, Hsieh MK, et al. Prediction of treatment response to neoadjuvant chemotherapy for breast cancer via early changes in tumor heterogeneity captured by DCE-MRI registration[J]. Scientific Reports, 2019, 9(1): 1-12. [15] Suzuki K. Overview of deep learning in medical imaging[J]. Radiological Physics and Technology, 2017, 10(3): 257-273. [16] Lundervold AS, Lundervold A. An overview of deep learning in medical imaging focusing on MRI[J]. Zeitschrift für Medizinische Physik, 2019, 29(2): 102-127. [17] Choi JH, Kim HA, Kim W, et al. Early prediction of neoadjuvant chemotherapy response for advanced breast cancer using PET/MRI image deep learning[J]. Scientific Reports, 2020, 10(1): 1-11. [18] Liu G, Mitra D, Jones EF, et al. Mask-guided convolutional neural network for breast tumor prognostic outcome prediction on 3D DCE-MR images[J]. Journal of Digital Imaging, 2021, 34(3): 630-636. [19] Byra M, Dobruch-Sobczak K, Klimonda Z, et al. Early prediction of response to neoadjuvant chemotherapy in breast cancer sonography using Siamese convolutional neural networks[J]. IEEE Journal of Biomedical and Health Informatics, 2020, 25(3): 797-805. [20] Schreiner S, Galloway RL. A fast maximum-intensity projection algorithm for generating magnetic resonance angiograms[J]. IEEE Transactions on Medical Imaging, 1993, 12(1): 50-57. [21] Hu Q, Whitney HM, Li H, et al. Improved classification of benign and malignant breast lesions using deep feature maximum intensity projection MRI in breast cancer diagnosis using dynamic contrast-enhanced MRI[J]. Radiology: Artificial Intelligence, 2021, 3(3): e200159. [22] He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778. [23] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition [DB/OL]. https://arxiv.org/pdf/ 1409.1556.pdf, 2015-04-10/2022-09-21. [24] Huang G, Liu Z, Van Der Maaten L, et al. Densely connected convolutional networks[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 4700-4708. [25] 赵顺,王树萌,秦金凤.基于机器学习预测乳腺癌患者新辅助化疗的病理完全反应[J].中国癌症防治杂志,2022,14(1):70-75. [26] 宋慧玲,崔艳芬,杨晓棠.乳腺癌动态增强磁共振成像纹理分析对新辅助化疗疗效预测与评估研究[J].肿瘤影像学,2020,29(3):241-249. [27] Rawat W, Wang Z. Deep convolutional neural networks for image classification: A comprehensive review[J]. Neural Computation, 2017, 29(9): 2352-2449. [28] Dong S, Wang P, Abbas K. A survey on deep learning and its applications[J]. Computer Science Review, 2021, 40: 100379. [29] Chitalia RD, Rowland J, McDonald ES, et al. Imaging phenotypes of breast cancer heterogeneity in preoperative breast dynamic contrast enhanced magnetic resonance imaging (DCE-MRI) scans predict 10-year recurrence radiomic phenotypes of tumor heterogeneity[J]. Clinical Cancer Research, 2020, 26(4): 862-869.
