Deep Cascaded Network for Automated Detection of Cancer MetastasisRegion from Whole Slide Image of Breast Lymph Node
Li Baoming1, Hu Jiarui1, Xu Haijun1, Wang Cong2, Jiang Yanni3, Zhang Zhihong2, Xu Jun1*
1 Jiangsu Key Laboratory of Big Data Analysis Technique, Nanjing University of Information Science and Technology, Nanjing 210044, China; 2 Department of Pathology, Jiangsu Province Hospital, Nanjing 210029, China; 3 Department of Radiology, Jiangsu Province Hospital, Nanjing 210029, China
Abstract：Automated recognition of the cancer metastasis region in lymph nodes is an essential prerequisite for the pathological staging of breast cancer. However, due to the massive size of panoramic images and the complexity and diversity of tissue morphology, it is challenging to automatically detect and locate the cancer metastasis areas in panoramic images of the lymph nodes. In this paper, a method based on the deep cascaded network was proposed to realize the automatic localization and recognition of tumor metastasis region in panoramic images of breast lymph nodes. We implemented a coarse-to-fine model cascading method and a coarse positioning network VGG16 was first trained based on positive and negative image blocks extracted from doctor marked region, and then compared with the doctor marked region to extract the image blocks from the positive and false positive areas. The finely positioned ResNet50 network was trained to identify the positive and false-positive regions. The effectiveness of the deep cascaded network was verified with a Camelyon16 dataset, which included a total of 400 whole slide images for training and testing. The FROC value of the positioning index of the VGG16+ResNet50 cascaded network model proposed in this paper reached 0.891 2, which was 0.153 1 and 0.147 0 higher than the single deep network models VGG16 and ResNet50, and only 0.028 8 higher than AlexNet+VGG16 cascaded network model, showing that the deep cascaded network model could achieve more accurate identification of lymph node cancer metastasis regions.
李宝明, 胡佳瑞, 徐海俊, 王聪, 蒋燕妮, 张智弘, 徐军. 基于深度级联网络的乳腺淋巴结全景图像的癌转移区域自动识别[J]. 中国生物医学工程学报, 2020, 39(3): 257-264.
Li Baoming, Hu Jiarui, Xu Haijun, Wang Cong, Jiang Yanni, Zhang Zhihong, Xu Jun. Deep Cascaded Network for Automated Detection of Cancer MetastasisRegion from Whole Slide Image of Breast Lymph Node. Chinese Journal of Biomedical Engineering, 2020, 39(3): 257-264.
[1] Bray F, Ferlay J, Soerjomataram I, et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA: A Cancer Journal for Clinicians, 2018, 68(6): 394-424. [2] Chen Wanqing, Zheng Rongshou, Baade PD, et al. Cancer statistics in China, 2015[J]. CA: A Cancer Journalfor Clinicians, 2016, 66(2): 115-132. [3] Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019[J]. CA: A Cancer Journal for Clinicians, 2019, 69(1): 7-34. [4] Chen R, Jing Yating, Jackson H. Identifying Metastases in Sentinel Lymph Nodes with Deep Convolutional Neural Networks[EB/OL]. https://arxiv.org/pdf/1608.01658.pdf, 2016-08-04/2019-11-21. [5] Gurcan MN, Boucheron L, Can A, et al. Histopathological Image Analysis: A Review[J]. IEEE Reviews in Biomedical Engineering, 2009, 2:147-171. [6] Cserni G, Bianchi S, Boecker W, et al. Improving the reproducibility of diagnosing micrometastases and isolated tumor cells[J]. Cancer, 2005, 103(2): 358-367. [7] Dalton LW, Pinder SE, Elston CE, et al. Histologic grading of breast cancer: Linkage of patient outcome withlevel of pathologist agreement[J]. Mod Pathol, 2000, 13(7):730-735. [8] Xu Jun, Xiang Lei, Liu Qinshan, et al. Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images[J]. IEEE Transactions on Medical Imaging, 2015, 35(1): 119-130. [9] Litjens G, Kooi T, Bejnordi BE, et al. A survey on deep learning in medical image analysis[J]. Medical Image Analysis, 2017, 42:60-88. [10] Cirean DC, Giusti A, Gambardella LM, et al. Mitosis detection in breast cancer histology images with deep neural networks[C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Berlin: Springer, 2013: 411-418. [11] Cruz-Roa A, Basavanhally A, González F, et al. Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks[C]//Medical Imaging 2014: Digital Pathology. San Diego: International Society for Optics and Photonics, 2014: 9041-904103. [12] Kovalev V, Kalinovsky A, Liauchuk V. Deeplearning in big image data: Histology image classification for breast cancer diagnosis[C]//The 2nd International Conference on Big Data and Advanced Analytics. Minsk: IEEE, 2016: 44-53. [13] Litjens G, Bandi P, Ehteshami Bejnordi B, et al. 1399 H&E-stained sentinel lymph node sections of breast cancer patients: The CAMELYON dataset[J]. Gigascience, 2018, 7(6): giy065. [14] Wang Dayong, Khosla A, Gargeya R, et al. Deep learning for identifying metastatic breast cancer[EB/OL]. https://arxiv.org/pdf/1606.05718.pdf, 2016-06-18/2019-11-21. [15] Shiraishi J, Fukuoka D, Hara T, et al. Basic concepts and development of an all-purpose computer interface for ROC/FROC observer study[J]. Radiological Physics & Technology, 2013, 6(1):35-41. [16] Bejnordi BE, Veta M, Van Diest PJ, et al. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer[J]. JAMA, 2017, 318(22): 2199-2210. [17] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[EB/OL]. https://arxiv.org/pdf/1409.1556.pdf, 2014-09-04/2019-11-12. [18] He Kaiming, Zhang Xiangyu, Ren S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEEConference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778. [19] Goode A, Gilbert B, Harkes J, et al. OpenSlide: A vendor-neutral software foundation for digital pathology[J]. J Pathol Inform, 2013, 4(1):27-30. [20] Otsu N. A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1): 62-66. [21] May M. A better lens on disease.[J]. Scientific American, 2010, 302(5):74-77. [22] Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks[C]//Advances inNeural Information Processing Systems. Carson City: Nips Foundation, 2012: 1097-1105. [23] Zeiler MD, Fergus R. Visualizing and understanding convolutional networks[C]//European Conference on Computer Vision. Berlin: Springer Cham, 2014: 818-833. [24] Byrd DR, Carducci MA, Compton CC, et al. AJCC cancer staging manual[M]. New York: Springer, 2010:97-100. [25] Xu Jun, Xiang Lei, Wang Guanhao, et al. Sparsenon-negative matrix factorization (SNMF) based color unmixing for breast histopathological image analysis.[J]. Computerized Medical Imaging & Graphics, 2015, 46:20-29. [26] Chen Jiamei, Qu Aiping, Wang Linwei, et al. New breast cancer prognostic factors identified by computer-aided image analysis of HE stained histopathology images[J]. Scientific Reports, 2015, 5: 10690.
