Abstract：The accuracy of colony image contour extraction is of great significance for microbial colony morphology and feature analysis. Based on the dynamic synaptic neural network, we constructed an image contour extraction method for colonies. Firstly, simulating the photoelectric conversion process of retinal, proposed an adaptive adjustment model of receptive field scale based on light intensity. Secondly, a LIF model combining the lateral regulation of electrical synapse and chemical synapse was constructed. Using neuron membrane potential, spatial distribution relationship and response time difference to adjust the strength of electrical synapse and chemical synapse, the colony edge sensitive image with or without lateral regulation was obtained. Finally, compared the difference of neurons response time with or without lateral regulation, and using STDP rules to dynamically update the weight of neuronal synaptic, so as to adjust the contour details of colony images. The adjusted contour response with the primary contour response were combined to obtain the final contour information of colony images. Taking 40 colony images collected in the laboratory as research objects, and selecting edge confidence BIdx, average reconstructed similarity MSSIM and comprehensive index EIdx as the evaluation indexes. The results showed that the contours obtained by this study was more accurate, continuous and has less noise. BIdx and MSSIM were 0.651 4±0.056 5 and 0.831 8±0.026 1, respectively. Meanwhile, EIdx was 0.765 7±0.027 4, which was significantly higher (P<0.01) than that of biological vision based methods of OS, BAR and LS. The dynamic synaptic neural network constructed in this paper is suitable for image contour extraction with rich detailed features such as colonies and may provide a new way for the research and application of neural computing models that integrate the biological vision mechanism.
蔡哲飞, 范影乐, 武薇. 基于动态突触神经网络的菌落图像轮廓提取方法[J]. 中国生物医学工程学报, 2022, 41(6): 699-707.
Cai Zhefei, Fan Yingle, Wu Wei. Contour Extraction Method of Colony Images Based on Dynamic Synaptic Neural Network. Chinese Journal of Biomedical Engineering, 2022, 41(6): 699-707.
[1] Zheng Yinfei, Zhou Yali, Zhou Hao, et al. Ultrasound image edge detection based on a novel multiplicative gradient and Canny operator [J]. Ultrasonic Imaging,2015,37(3): 238-250. [2] Bertasius G, Shi J, Torresani L. Deepedge: a multi-scale bifurcated deep network for top-down contour detection [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston: IEEE, 2015: 4380-4389. [3] Xie Saining, Tu Zhuowen. Holistically-nested edge detection [C]//Proceedings of the IEEE International Conference on Computer Vision (ICCV). Santiago: IEEE, 2015: 1395-1403. [4] Hui Wei, Lang Bo, Zuo Qingsong. Contour detection model with multi-scale integration based on non-classical receptive field [J]. Neurocomputing, 2013, 103: 247-262. [5] Kerr D, Coleman S, McGinnity M, et al. Biologically inspired edge detection [C]//The 11th International Conference on Intelligent Systems Design and Applications. Córdoba: IEEE, 2011: 802-807. [6] Fang Tao, Fan Yingle, Wu Wei. Salient contour detection on the basis of the mechanism of bilateral asymmetric receptive fields[J]. Signal, Image and Video Processing. 2020, 14(7): 1461-1469. [7] 潘晴,严国萍,张玉宽. 基于人眼视觉注视机制下突触短时可塑性的图像边缘检测算法[J]. 中国图象图形学报,2008,13(7):1316-1321. [8] 余翔,范影乐,房涛,等. 基于长短时程突触互补网络的边缘检测方法[J]. 中国生物医学工程学报,2020,39(6):641-651. [9] Bi Guoqiang, Poo Mumin. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type [J]. Journal of Neuroscience, 1998, 18(24): 10464-10472. [10] Lee C, Srinivasan G, Panda P, et al. Deep spiking convolutional neural network trained with unsupervised spike-timing-dependent plasticity [J]. IEEE Transactions on Cognitive and Developmental Systems, 2018, 11(3): 384-394. [11] Zhou Yongcheng, Zhang Anguo. Improved integrate-and-fire neuron models for inference acceleration of spiking neural networks[J]. Applied Intelligence, 2021, 51(4): 2393-2405. [12] Demšar J, Forsyth R. Synaptic scaling improves the stability of neural mass models capable of simulating brain plasticity [J]. Neural Computation, 2020, 32(2): 424-446. [13] Si Hao, Sun Xiaojuan. Information propagation in recurrent neuronal populations with mixed excitatory-inhibitory synaptic connections[J]. Nonlinear Dynamics, 2021, 104(1): 557-576. [14] Chen Y, Ko H, Zemelman B V, et al. Uniform spatial pooling explains topographic organization and deviation from receptive-field scale invariance in primate V1 [J]. Nature Communications, 2020,11(1):6390. [15] Zhao Hanli, Qiu Xiaqing, Lu Wanglong, et al. High‐quality retinal vessel segmentation using generative adversarial network with a large receptive field [J]. International Journal of Imaging Systems and Technology,2020,30(3): 828-842. [16] Thorpe S, Fize D, Marlot C. Speed of processing in the human visual system [J]. Nature, 1996, 381(6582): 520-522. [17] Jody R, Barani R. Capturing impressions of pedestrian landscapes used for healing purposes with decision tree learning[J]. Landscape and Urban Planning,2004,73(2): 155-166. [18] Zhou J, Gu X, Gu C, et al. Cellular coupling determines scale-invariant behavior of neurons in suprachiasmatic nucleus [J]. Chronobiology International, 2020, 37(12): 1669-1676. [19] 桑农, 唐奇伶, 张天序. 基于初级视皮层抑制的轮廓检测方法[J].红外与毫米波学报,2007, 26(1):47-51. [20] Nadel L, Maurer AP. Recalling Lashley and reconsolidating Hebb[J]. Hippocampus, 2020, 30(8): 776-793. [21] Chu D, Le NH. Constraints on Hebbian and STDP learned weights of a spiking neuron[J]. Neural Networks, 2021, 135: 192-200. [22] Govindarajani B, Panetta KA, Agaian S. Image reconstruction for quality assessment of edge detectors [C]//IEEE International Conference on Systems, Man and Cybernetics. Singapore: IEEE, 2008:691-696. [23] Meer P, Georgescu B. Edge detection with embedded confidence [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(12): 1351-1365. [24] Wang Z, Bovik AC, Sheikh HR, et al. Image quality assessment: from error visibility to structural similarity [J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612. [25] 王典,范影乐,张梦楠,等. 基于突触连接视通路方位敏感的图像分级边缘检测方法[J]. 中国生物医学工程学报,2015,34(5):522-532. [26] Beznik T, Smyth P, de Lannoy G, et al. Deep learning to detect bacterial colonies for the production of vaccines[J]. Neurocomputing, 2022, 470: 427-431. [27] Berberian N, Ross M, Chartier S, et al. Synergy between short-term and long-term plasticity explains direction-selectivity in visual cortex[C]//2017 IEEE Symposium Series on Computational Intelligence (SSCI). Hawaii: IEEE, 2017: 1-8.
