Study of Temporal Pattern of Embryonic Angiogenesis Based on Interpretable Convolutional Neural Networks
Lv Xueqian1, Zhao Shenjia1, Li Peilun2, Fang Luping1, Ning Gangmin2#, Pan Qing1#*
1(College of Information Engineering,Zhejiang University of Technology,Hangzhou 310023,China) 2(Department of Biomedical Engineering,Zhejiang University,Hangzhou 310027,China)
Abstract：Understanding temporal patterns of vascular network angiogenesis facilitates the study of biological development mechanisms and the pathophysiology of tumors. In this paper,an interpretable convolutional neural network (CNN) was proposed to study the temporal pattern of angiogenesis of the chicken vitelline vascular networks. We constructed a model for classifying the vascular images of chicken vitelline at 3 days post-fertilization (3dpf) and 4 days post-fertilization (4dpf) based on CNN,explained the classification results using gradient-weighted class activation mapping (Grad-CAM),and analyzed the angiogenic pattern from 3dpf to 4dpf based on the model. A total of 17 fertilized eggs were observed in the experiment. Results showed that the accuracy of the optimal model to classify 3dpf and 4dpf vascular images was 98.62%. Using the Grad-CAM technique,we found out that the main manifestation of the vascular network development from 3dpf to 4dpf was the growth of capillary networks. Between 3dpf and 4dpf,the process of angiogenesis was more intense during the first 12 hours and then tended to be stable. This study provided new approaches for the researches on angiogenesis,assisting the physiological studies including angiogenesis mechanisms,tumor growth and organ aging.
吕雪倩, 赵沈佳, 李佩伦, 方路平, 宁钢民, 潘清. 基于可解释卷积神经网络的胚胎血管新生时间模式研究[J]. 中国生物医学工程学报, 2020, 39(5): 524-531.
Lv Xueqian, Zhao Shenjia, Li Peilun, Fang Luping, Ning Gangmin, Pan Qing. Study of Temporal Pattern of Embryonic Angiogenesis Based on Interpretable Convolutional Neural Networks. Chinese Journal of Biomedical Engineering, 2020, 39(5): 524-531.
[1] Carmeliet PMJ.Mechanisms of angiogenesis and arteriogenesis[J].Nature Medicine,2000,6(4):389-395. [2] Machado MJC,Watson MG,Devlin AH,et al.Dynamics of angiogenesis during wound healing:a coupled in vivo and in silico study[J].Microcirculation,2011,18(3):183-197. [3] Carmeliet P,Jain RK.Angiogenesis in cancer and other diseases[J].Nature,2000,407(6801):249-257. [4] 杨婧,王志坚.斑马鱼胚胎早期血管系统的形成[J].生命的化学,2009,29(2):118-121. [5] Ellertsdóttir E,Lenard A,Blum Y,et al.Vascular morphogenesis in the zebrafish embryo[J].Developmental Biology,2010,341(1):56-65. [6] Le Noble F,Moyon D,Pardanaud L,et al.Flow regulates arterial-venous differentiation in the chick embryo yolk sac[J].Development,2004,131(2):361-375. [7] Buschmann I,Pries AR,Styp-Rekowska B,et al.Pulsatile shear and Gja5 modulate arterial identity and remodeling events during flow-driven arteriogenesis[J].Development,2010,137(13):2187-2196. [8] 姚昶,薛涛,朱永康,等.鸡胚绒毛尿囊膜模型在微血管实验研究中的应用[J].微循环学杂志,2005,15(4):70-73. [9] Smith AF,Nitzsche B,Maibier M,et al.Microvascular hemodynamics in the chick chorioallantoic membrane[J].Microcirculation,2016,23(7):512-522. [10] Nagai H,Shin M,Weng Wei,et al.Early hematopoietic and vascular development in the chick[J].International Journal of Developmental Biology,2018,62(1-3):137-144. [11] ŠućrovićS,Nikolić T,Brosens JJ,et al.Spatial and temporal analyses of FGF9 expression during early pregnancy[J].Cell Physiol Biochem,2017,42(6):2318-2329. [12] Isogai S,Lawson ND,Torrealday S,et al.Angiogenic network formation in the developing vertebrate trunk[J].Development,2003,130(21):5281-5290. [13] Vico PG,Kyriacos S,Heymans O,et al.Dynamic study of the extraembryonic vascular network of the chick embryo by fractal analysis[J].Journal of Theoretical Biology,1998,195(4):525-532. [14] Gulshan V,Peng L,Coram M,et al.Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs[J].Journal of the American Medical Association,2016,316(22):2402-2410. [15] Esteva A,Kuprel B,Novoa RA,et al.Dermatologist-level classification of skin cancer with deep neural networks[J].Nature,2017,542(7639):115-118. [16] Kermany DS,Goldbaum M,Cai W,et al.Identifying medical diagnoses and treatable diseases by image-based deep learning[J].Cell,2018,172(5):1122-1131. [17] Jeanray N,Marée RL,Pruvot B,et al.Phenotype classification of zebrafish embryos by supervised learning[J].PLoS ONE,2015,10(1):1-20. [18] Kittler J,Illingworth J.Minimum error thresholding[J].Pattern Recognition,1986,19(1):41-47. [19] Lecun Y,Bottou L,Bengio Y,et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324. [20] Krizhevsky A,Sutskever I,Hinton GE.ImageNet classification with deep convolutional neural networks[C]//Advances in Neural Information Processing Systems 25.New York:Curran Associates Inc,2012:1097-1105. [21] Simonyan K,Zisserman AJCS.Very deep convolutional networks for large-scale image recognition[C]//International Conference on Learning Representations.San Diego:2015:1-14. [22] Szegedy C,Liu Wei,Jia Yangqing,et al.Going deeper with convolutions[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition.Boston:IEEE,2015:1-9. [23] He Kaiming,Zhang Xiangyu,Ren Shaoqing,et al.Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE,2016:770-778. [24] Jia Shijie,Wang Ping,Jia Peiyi,et al.Research on data augmentation for image classification based on convolution neural networks[C]//2017 Chinese Automation Congress.Jinan:IEEE,2017:4165-4170. [25] Selvaraju RR,Cogswell M,Das A,et al.Grad-CAM:Visual explanations from deep networks via gradient-based localization[C]//2017 IEEE International Conference on Computer Vision.Venice:IEEE,2017:618-626. [26] Nardelli P,Daniel JC,David BP,et al.Pulmonary artery-vein classification in CT images using deep learning[J].IEEE Transactions on Medical Imaging,2018,37(11):2428-2440. [27] Welikala RA,Foster PJ,Whincup PH,et al.Automated arteriole and venule classification using deep learning for retinal images from the UK Biobank cohort[J].Computers in Biology and Medicine,2017,90(1):23-32. [28] Secomb TW,Alberding JP,Hsu R,et al.Angiogenesis:An adaptive dynamic biological patterning problem[J].PLoS Computational Biology,2013,9(3):1-12. [29] Roman BL,Pekkan K.Mechanotransduction in embryonic vascular development[J].Biomechanics and Modeling in Mechanobiology,2012,11(8):1149-1168.
