基于卷积神经网络和多信息融合的三维乳腺超声分类方法

doi:10.3969/j.issn.0258-8021.2018.04.004

摘要
图/表
参考文献(23)
相关文章 (14)

全文: PDF (4269 KB) HTML (1 KB)
输出: BibTeX | EndNote (RIS)

摘要乳腺肿瘤超声图像的自动分类对于提高医生的工作效率和降低漏诊率具有十分重要的意义。新型的三维乳腺超声数据包含更多的可用于诊断的信息,但由于超声成像机理导致不同方向上的图像表现不同。针对该种乳腺超声数据,利用卷积神经网络结构的灵活性和自动学习的特性,提出3种改进的卷积神经网络模型,使其分别可以接受横截面图像输入、横截面和冠状面的双图像输入、图像和文本信息同时输入,并研究不同信息的融合对于提升乳腺肿瘤自动分类准确率的影响。在研究中,采用880幅图像(良性401幅,恶性479幅)及其标注信息进行5折交叉验证实验,得到各模型的准确率及AUC。实验结果表明,设计的模型可以适应图片与文本信息的输入,多信息融合的模型比只接受图像输入的模型准确率提升2.91%,达到75.11%的准确率和0.829 4的AUC。这些模型的提出,为多信息融合的卷积神经网络分类应用提供参考。

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	孔小函
	檀韬
	包凌云
	王广志

关键词 ：三维乳腺超声, 医学图像分类, 卷积神经网络, 多信息融合

Abstract：The automatic classification of breast tumor in ultrasound images is of great significance to improve doctors' efficiency and reduce the rate of misdiagnosis. The novel 3D breast ultrasound data contains more information for diagnosis, but images from different directions have their distinct performance as a result of this ultrasound imaging mechanism. For this breast ultrasound data, this paper designed three kinds of convolutional neural network model using its flexibility and characteristic of learning automatically, and the three models were able to accept transverse plane images, transverse plane and coronal plane images, images and annotations information. The effects of different information fusion on the accuracy of breast tumor classification were investigated. A dataset contains 880 images (i.e., 401 benign images, 479 malign images) and their annotations were employed, and we performed 5-fold cross validation to calculate the accuracy and AUC of each model. The experimental results indicated that the models designed in this paper can deal with the images and annotations simultaneously. Compared with the single-input model, the multi-information fusion model improved the accuracy of classification by 2.91%, and achieved the accuracy of 75.11% and AUC of 0.829 4. The proposed models provided a reference for the classification application of convolutional neural networks with multi-information fusion.

Key words： 3D breast ultrasound medical image classification convolutional neural networks multi-information fusion

收稿日期: 2018-01-31

PACS:

R318

通讯作者: E-mail: wgz-dea@tsinghua.edu.cn

引用本文:

孔小函, 檀韬, 包凌云, 王广志. 基于卷积神经网络和多信息融合的三维乳腺超声分类方法[J]. 中国生物医学工程学报, 2018, 37(4): 414-422.
Kong Xiaohan, Tan Tao, Bao Lingyun, Wang Guangzhi. Classification of Breast Mass in 3D Ultrasound Images with Annotations Based on Convolutional Neural Networks. Chinese Journal of Biomedical Engineering, 2018, 37(4): 414-422.

链接本文:

http://cjbme.csbme.org/CN/10.3969/j.issn.0258-8021.2018.04.004 或 http://cjbme.csbme.org/CN/Y2018/V37/I4/414

[1] Torre LA, Bray F, Siegel RL, et al. Global cancer statistics, 2012[J]. CA: a cancer journal for clinicians, 2015, 65(2): 87-108.
[2] Lin Xi, Wang Jianwei, Han Feng, et al. Analysis of eighty-one cases with breast lesions using automated breast volume scanner and comparison with handheld ultrasound[J]. European Journal of Radiology, 2012, 81(5): 873-878.
[3] Jalalian A, Mashohor SBT, Mahmud HR, et al. Computer-aided detection/diagnosis of breast cancer in mammography and ultrasound: a review[J]. Clinical Imaging, 2013, 37(3): 420-426.
[4] Zhou Shichong, Shi Jun, Zhu Jie, et al. Shearlet-based texture feature extraction for classification of breast tumor in ultrasound image[J]. Biomedical Signal Processing and Control, 2013, 8(6): 688-696.
[5] Wu WJ, Lin SW, Moon WK. Combining support vector machine with genetic algorithm to classify ultrasound breast tumor images[J]. Computerized Medical Imaging and Graphics, 2012, 36(8): 627-633.
[6] Moon WK, Shen YW, Huang CS, et al. Computer-aided diagnosis for the classification of breast masses in automated whole breast ultrasound images[J]. Ultrasound in Medicine and Biology, 2011, 37(4): 539-548.
[7] Tan Tao, Platel B, Huisman H, et al. Computer-aided lesion diagnosis in automated 3-D breast ultrasound using coronal spiculation[J]. IEEE Transactions on Medical Imaging, 2012, 31(5): 1034-1042.
[8] Schmidhuber J. Deep learning in neural networks: An overview[J]. Neural Networks, 2015, 61: 85-117.
[9] Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks[C]//Neural Information Processing Systems. Lake Tahoe: Nips Foundation, 2012: 1097-1105.
[10] Szegedy C, Liu Wei, Jia Yangqing, et al. Going deeper with convolutions[C]// Computer Vision and Pattern Recognition. Boston: IEEE, 2015:1-9.
[11] He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778.
[12] Greenspan H, Ginneken BV, Summers RM. Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique[J]. IEEE Transactions on Medical Imaging, 2016, 35(5): 1153-1159.
[13] Dhungel N, Carneiro G, Bradley AP. The automated learning of deep features for breast mass classification from mammograms[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Athens: Springer, 2016: 106-114.
[14] Jiang Fan, Liu Hui, Yu Shaode, et al. Breast mass lesion classification in mammograms by transfer learning[C]//Proceedings of the 5th International Conference on Bioinformatics and Computational Biology. Hong Kong: ACM, 2017: 59-62.
[15] Spanhol FA, Oliveira LS, Petitjean C, et al. Breast cancer histopathological image classification using convolutional neural networks[C]//International Joint Conference on Neural Networks. Vancouver: IEEE, 2016: 2560-2567.
[16] Bayramoglu N, Kannala J, Heikkilä J. Deep learning for magnification independent breast cancer histopathology image classification[C]//International Conference on Pattern Recognition. Cancun: IEEE, 2016: 2440-2445.
[17] Cheng Jiezhi, Ni Dong, Chou Yihong, et al. Computer-aided diagnosis with deep learning architecture: applications to breast lesions in US images and pulmonary nodules in CT scans[J]. Scientific Reports, 2016, 6: 24454.
[18] Han S, Kang HK, Jeong JY, et al. A deep learning framework for supporting the classification of breast lesions in ultrasound images[J]. Physics in Medicine & Biology, 2017, 62(19): 7714.
[19] Zeiler MD, Fergus R. Visualizing and understanding convolutional networks[C]//European Conference on Computer Vision. Zurich: Springer, Cham, 2014: 818-833.
[20] LeCun Y, Bottou L, Bengio Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE: 1998, 86(11): 2278-2324.
[21] 张渊, 江泉, 陈剑,等. 三维超声鉴别诊断乳腺肿块良恶性的优势[J]. 中国超声医学杂志, 2010, 26(4):311-314.
[22] Abadi M, Barham P, Chen Jianmin, et al. TensorFlow: A system for large-scale machine learning[C]// Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. Savannah: USENIX Association, 2016, 16: 265-283.
[23] Shin HC, Roth HR, Gao Mingchen, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning[J]. IEEE Transactions on Medical Imaging: 2016, 35(5): 1285-1298.