Triple Attention Segmentation Network for Brain Tumor Images
Han Yang1,2,3, Song Jinmiao2,3, Xue Anyi1, Duan Xiaodong1,2,3*
1(College of Computer Science and Engineering, Dalian Minzu University, Dalian 116600, Liaoning, China) 2(SEAC Key Laboratory of Big Data Applied Technology, Dalian Minzu University, Dalian 116600, Liaoning, China) 3(Dalian Key Lab of Digital Technology for National Culture, Dalian Minzu University, Dalian 116600, Liaoning, China)
Abstract：Brain tumor segmentation is the basis of clinical routine and treatment of brain tumor diseases with computer-aided diagnosis. In this paper, we proposed a triple attention segmentation network based on brain tumor images, aiming to solve the problems of the current brain tumor MRI image segmentation network that has too many layers and is lack of connection between local and global feature information, which leads to the reduction of image segmentation accuracy. First, inspired by the residual network, we replaced the convolution module both in the encoding and decoding layer of the original segmentation network with a deep residual module to solve the problem of gradient disappearance caused by network deepening. Next, by introducing a triple attention module to combine local and global image features, the network was able to learn important image features better and improved the network's segmentation accuracy of brain tumor images. Finally, The improved network was evaluated by the Dice coefficient, and other brain tumor indicators were adopted on the BraTS brain tumor MRI image datasets released by the MICCAI competition includes 335 patient cases, among which the whole brain tumor score reached 85.20%, the brain tumor core score reached 87.10%, and the enhanced brain tumor area score reached 80.80%. Experimental results showed that the proposed segmentation network increased the segmentation performance of brain tumor MRI images without increasing the training time.
[1] Siegel R, Miller K, Jemal A. Cancer statistics, 2019[J]. CA: A Cancer Journal for Clinicians, 2019, 69(1): 7-34. [2] 刘昊,王冠华,章强,等. 3D脑肿瘤分割的Dice损失函数的优化[J].中国医疗设备, 2019, 34(5): 20-23,31. [3] Krizhevsky A, Sutskever I, Hinton G. ImageNet classification with deep convolutional neural networks[C]//International Conference on Neural Information Processing Systems. West Chesten: Curran Associates Inc, 2012: 1097-1105. [4] Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecturefor image segmentation [J]. IEEE Trans Pattern Anal Mach Intell, 2017, 39(12): 2481-2495. [5] He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition[C] //Proceedings of the International Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE,2016: 770-778. [6] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 39(4): 640-651. [7] Ghiasi G, Fowlkes CC. Laplacian pyramid reconstruction and refinement for semantic segmentation[C] //European Conference on Computer Vision. Amsterdam: Springer, 2016: 519-534. [8] Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C] //Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin: Springer, 2015: 234-241. [9] Hu J, Shen L, Albanie S, et al. Squeeze-and-excitation networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(8): 2011-2023. [10] Woo S, Park J, Lee J, et al. CBAM: Convolutional Block Attention Module[M].Cham: Springer, 2018. [11] Fu Jun, Liu Jing, Tian Haijie, et al. Dual attention network for scene segmentation [DB/OL]. https://arxiv.org/abs/1809.02983, 2019-04-21/2020-12-18. [12] Myronenko A. 3D MRI brain tumor segmentation using autoencoder regularization[C] //International MICCAI Brainlesion Workshop. Granada: Springer, 2018: 311-320. [13] Hu K, Gan Q, Zhang Y, et al. Brain tumor segmentation using multi-cascaded convolutional neural networks and conditional random field [J]. IEEE Access, 2019, 7: 92615-92629. [14] Tianming Z, Yongzhao Z, Zhe L, et al. Automatic method for white matter lesion segmentation based on T1-fluid-attenuated inversion recovery images[J]. IET Computer Vision, 2015, 9(4): 447-455. [15] Haichun L, Ao L, Minghui W. A novel end-to-end brain tumor segmentation method using improved fully convolutional networks[J]. Computers in Biology and Medicine, 2019, 108: 150-160. [16] Alom M, Yakopcic C, Hasan M, et al. Recurrent residual U-Net for medical image segmentation[J]. Journal of Medical Imaging, 2019, 6(1): 345-350. [17] Liu Z, Huang J, Zhu C, et al. Residual attention network using multi-channel dense connections for image super-resolution[J]. Applied Intelligence, 2021, 51(1): 85-99. [18] 曹玉红,徐海,刘荪傲,等. 基于深度学习的医学影像分割研究综述[J].计算机应用,2021,41(8):2273-2287. [19] Alom MZ, Yakopcic C, Hasan M, et al. Recurrent residual U-Net for medical image segmentation[J]. Journal of Medical Imaging, 2019, 6(1): 014006. [20] Schlemper J, Oktay O, Schaap M, et al. Attention gated networks: Learning to leverage salient regions in medical images [J]. Medical Image Analysis, 2019, 53: 197-207.
