|
|
Multiscale Attention-Based CNN Model for Vessel Enhancement of Coronary Angiography |
Zhou Peng, Wang Guangpu, Gao Hui, Qin Zewei, Wang Shuo, Yu Hui* |
(Department of Biomedical Engineering, Tianjin University, Tianjin 300072, China) |
|
|
Abstract Coronary angiography records the dynamic process of developing vessels with blood flow, which is interfered by cardiac motion, resulting in poor image quality, seriously affecting the diagnosis of physicians, and at the same time is not conducive to the intelligent assisted diagnosis of coronary heart disease. In this paper, a vessel enhancement network for coronary angiography with multi-scale attention based on CNN was proposed. The network consisted of multi-scale attention block (MAB) and large kernel attention tail (LKAT). The MAB contained multi-scale large kernel attention (MLKA) and gated spatial attention block (GSAB), the module was able to extract more local and global vessel information while avoiding the grid effect. The LKAT showed the ability to aggregate long-range information, which improved the characterization of reconstructed vascular features and thus enhanced the reconstruction quality of coronary angiography images. The 2 666 coronary datasets in the experiment were manually labeled by medical expert pairs, and the obtained vessel segmentation labels were used as masks, which were superimposed onto the Gaussian-filtered preprocessed images as coronary enhancement labels. Compared with the existing state-of-the-art methods, the enhancement effect was remarkable, with PSNR and SSIM reaching 34.880 1 and 0.973 2, respectively. Moreover, the enhanced segmentation results achieved Dice and IoU of 0.851 4 and 0.741 3, respectively, with Acc and Recall reaching 98.55% and 89.05%. The experimental results showed that the method realizes intelligent enhancement of coronary angiography images, and it also facilitates the follow-up of the intelligent auxiliary diagnosis of coronary heart disease processing.
|
Received: 30 November 2023
|
|
Corresponding Authors:
*E-mail:yuhui@tju.edu.cn
|
|
|
|
[1] 胡盛寿, 王增武. 《中国心血管健康与疾病报告2022》概要 [J]. 中国介入心脏病学杂志, 2023, 31(7): 485-508. [2] Virani SS, Newby LK, Arnold SV, et al. 2023 AHA/ACC/ACCP/ASPC/NLA/PCNA guideline for the management of patients with chronic coronary disease: a report of the American Heart Association/American College of Cardiology Joint Committee on Clinical Practice Guidelines [J]. Circulation, 2023, 148(9): 9-119. [3] Disease MWGFCC, Winchester DE, Maron DJ, et al. ACC/AHA/ASE/ASNC/ASPC/HFSA/HRS/SCAI/SCCT/SCMR/STS 2023 multimodality appropriate use criteria for the detection and risk assessment of chronic coronary disease [J]. Journal of the American College of Cardiology, 2023, 81(25): 2445-2467. [4] Wan Tao, Shang Xiaoqing, Yang Weilin, et al. Automated coronary artery tree segmentation in X-ray angiography using improved Hessian based enhancement and statistical region merging [J]. Computer Methods and Programs in Biomedicine, 2018, 157: 179-190. [5] Hashemi S, Paul NS, Beheshti S, et al. Adaptively tuned iterative low dose CT image denoising [J]. Computational and Mathematical Methods in Medicine, 2015, 2015:24-36. [6] Hong Shangguan, Zhang Quan, Liu Yi, et al. Low-dose CT statistical iterative reconstruction via modified MRF regularization [J]. Computer Methods and Programs in Biomedicine, 2016, 123: 129-141. [7] Sidky EY, Kao CM, Pan X. Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT [J]. Journal of X-ray Science and Technology, 2006, 14(2): 119-139. [8] Zhang Ruoqiao, Ye DH, Pal D, et al. A Gaussian mixture MRF for model-based iterative reconstruction with applications to low-dose X-ray CT [J]. IEEE Transactions on Computational Imaging, 2016, 2(3): 359-374. [9] Kang D, Slomka P, Nakazato R, et al. Image denoising of low-radiation dose coronary CT angiography by an adaptive block-matching 3D algorithm [C] //Medical Imaging 2013: Image Processing. Florida: SPIE, 2013: 671-676. [10] 陈建辉, 赵蕾, 李德玉, 等. 基于冠脉造影图像血管树分割的血管狭窄自动识别方法 [J]. 中国生物医学工程学报, 2019, 38(3): 266-272. [11] 汪光普. 冠状动脉DSA影像SYNTAX智能评分关键技术研究 [D]. 天津:天津大学, 2020. [12] Frangi AF, Niessen WJ, Vincken KL, et al. Multiscale vessel enhancement filtering[C]//Medical Image Computing and Computer-Assisted Intervention—MICCAI’98. Heidelberg: Springer, 1998: 130-137. [13] Song Shuang, Yang Jia, Danni Ai, et al. Patch-based adaptive background subtraction for vascular enhancement in X-Ray cineangiograms [J]. IEEE J Biomed Health Inform, 2019, 23(6): 2563-2575. [14] Song Shuang, Du Chenbing, Ai Danni, et al. Spatio-temporal constrained online layer separation for vascular enhancement in X-ray angiographic image sequence [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30(10): 3558-3570. [15] Qin Binjie, Mao Haohao, Liu Yiming, et al. Robust PCA unrolling network for super-resolution vessel extraction in X-ray coronary angiography [J]. IEEE Trans Med Imaging, 2022, 41(11): 3087-3098. [16] Wang Yan, Li Yusen, Wang Gang, et al. Multi-scale attention network for single image super-resolution[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE 2024: 5950-5960. [17] Zhang Xindong, Zeng Hui, Zhang Lei. Edge-oriented convolution block for real-time super resolution on mobile devices[C]//Proceedings of the 29th ACM International Conference on Multimedia. Chengdu: ACM, 2021: 4034-4043. [18] Wang Xintao, Yu Ke, Wu Shixiang, et al. Esrgan: enhanced super-resolution generative adversarial networks[C]// Proceedings of the European Conference on Computer Vision (ECCV) Workshops. Munich: Springer, 2018: 4011-4023. [19] Ledig C, Theis L, Huszár F, et al. Photo-realistic single image super-resolution using a generative adversarial network [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Virtual: IEEE, 2017: 4681-4690. [20] Liang Jingyun, Cao Jezhang, Sun Guolei, et al. Swinir: Image restoration using swin transformer[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Virtual: IEEE, 2021: 1833-1844. [21] Wang, Guangpu, Zhou Peng, Gao Hui, et al. Coronary vessel segmentation in coronary angiography with a multi-scale U-shaped transformer incorporating boundary aggregation and topology preservation[J]. Physics in Medicine & Biology, 2024, 69(2): 12-28. [22] Xia Shaoyan, Zhu Haogang, Liu Xiaoli, et al. Vessel segmentation of X-ray coronary angiographic image sequence [J]. IEEE Trans Biomed Eng, 2020, 67(5): 1338-1348. |
[1] |
Wang Wei, Xu Yuyan, Wang Xin, Huang Wendi, Yuan Ping. Research on Chest CT Image Classification Method Combining Attention Mechanism and Lightweight Convolutional Neural Network[J]. Chinese Journal of Biomedical Engineering, 2024, 43(4): 429-437. |
[2] |
Zhang Yao, Liu Yanjun, Liu Lei. Atrial Fibrillation Detection and ECG Heartbeat Classification Algorithm Based on Inception Module and CNN-BiLSTM[J]. Chinese Journal of Biomedical Engineering, 2024, 43(4): 447-454. |
|
|
|
|