Research on the Effect of Visual Presentation Speed on Working Memory Based on EEG Brain Network
Wang Bixiao1,2, Chen Yao1,2, Li Xin1,2, Wang Shenglin1,2, Huang Liya1,2*
1(College of Electronic and Optical Engineering & College of Microelectronics, Nanjing University of Posts and Telecommunications, Nanjing 210023,China) 2(National and Local Joint Engineering Laboratory of RF Integration and Micro-Assembly Technology, Nanjing 210023, China)
Abstract：With the quickening pace of life, multiple playbacks have been widely used in learning process, and the impacts on the learning cognitive activities have gradually attracted attentions of researches. In order to explore the effect of visual presentation speed of memory tasks on working memory and its mechanism, this paper studied from the view of EEG brain network. An experimental paradigm was designed under the two presentation speeds of fast and slow. EEG data of 18 subjects were collected, power spectrum of each frequency band was calculated, and the frequency band with significant difference (P<0.05) was selected for analysis. The Granger causality method was used to calculate the causal relationship between brain regions in different frequency bands, and a weighted causal brain network was constructed. The three network characteristics of the network, namely, the degree of entry, the degree of exit, and the clustering coefficient, were analyzed. Support vector machines were used to classify the brain networks in the fast and slow state. The results showed that in the fast visual presentation state, the access of the brain network increased, and the node clustering coefficient was further strengthened, and the nodes with significant differences were mainly distributed in the frontal lobe, parietal lobe and occipital lobe, which were significantly higher than those in the slow visual presentation state (P<0.05). The classification accuracy of the brain network in the fast and slow state was up to 90.96%, 90.29% and 86.53% respectively by taking the access, exit and clustering coefficient of each frequency band as characteristics. This study showed that with the acceleration of visual presentation and the further activation of visual processing, the subjects' working memory awareness activities were gradually enhanced, and the leading role of the left hemisphere of the brain in cognitive activities such as language and reasoning were also continuously strengthened. In conclusion, this paper investigated the directed brain network in two states, fast and slow, which provided a new insight for exploring the impact of playback speed on learning cognitive activities, as well as a theoretical basis for learning video designers to set playback speed.
王碧霄, 陈瑶, 李鑫, 王盛淋, 黄丽亚. 基于EEG脑网络的视觉呈现速度对工作记忆影响的研究[J]. 中国生物医学工程学报, 2023, 42(3): 257-265.
Wang Bixiao, Chen Yao, Li Xin, Wang Shenglin, Huang Liya. Research on the Effect of Visual Presentation Speed on Working Memory Based on EEG Brain Network. Chinese Journal of Biomedical Engineering, 2023, 42(3): 257-265.
[1] 杨硕, 江文涛, 王磊, 等.基于脑网络的脑疲劳对不同工作记忆负荷的影响[J]. 中国生物医学工程学报, 2021, 40(4): 446-452. [2] Johnson CI, Mayer RE. A testing effect with multimedia learning[J]. Journal of Educational Psychology, 2009, 101(3): 621-629. [3] Varnavsky AN. Research of preference in playback speed of learning video material depending on indicators of cognitive processes[C]//2016 Cognitive Sciences, Genomics and Bioinformatics (CSGB). Russia:IEEE, 2016: 1-4. [4] Bo H, Li H, Ma L, et al. Time-course EEG spectrum evidence for music key perception and emotional effects[C]//International Conference on Brain Inspired Cognitive Systems. Cham:Springer, 2016: 184-195. [5] Cohen MX. Where does EEG come from and what does it mean?[J]. Trends in Neurosciences, 2017, 40(4): 208-218. [6] Abrams DA, Lynch CJ, Cheng KM, et al. Underconnectivity between voice-selective cortex and reward circuitry in children with autism[J]. Proceedings of the National Academy of Sciences, 2013, 110(29): 12060-12065. [7] Muthukrishnan SP, Soni S, Sharma R. Brain networks communicate through theta oscillations to encode high load in a visuospatial working memory task: an EEG connectivity study[J]. Brain Topography, 2020, 33(1): 75-85. [8] Ding Weiwei, Zhang Yuheng, Huang Liya. Using a novel functional brain network approach to locate important nodes for working memory tasks[J]. International Journal of Environmental Research and Public Health, 2022, 19(6): 3564-3577. [9] Protopapa F, Siettos CI, Evdokimidis I, et al. Granger causality analysis reveals distinct spatio-temporal connectivity patterns in motor and perceptual visuo-spatial working memory[J]. Frontiers in Computational Neuroscience, 2014, 8(8): 146. [10] Jasper HH. The ten-twenty electrode system of the International Federation[J]. Electroencephalogr. Clin. Neurophysiol., 1958, 10: 370-375. [11] 刘爽, 仝晶晶, 郭冬月, 等. 情绪影响工作记忆的研究现状与发展动向[J]. 中国生物医学工程学报, 2017, 36(6): 724-732. [12] Tadel F, Baillet S, Mosher JC, et al. Brainstorm: a user-friendly application for MEG/EEG analysis[J]. Computational Intelligence and Neuroscience, 2011, 2011: 879716-879728. [13] Jutten C, Herault J. Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture[J]. Signal Processing, 1991, 24(1): 1-10. [14] Xia M, Wang J, He Y. BrainNet Viewer: a network visualization tool for human brain connectomics[J]. PLoS ONE, 2013, 8(7): e68910. [15] Granger CWJ. Investigating causal relations by econometric models and cross-spectral methods[J]. Econometrica, 1969, 37(3):424-438. [16] Barrett AB, Murphy M, Bruno MA, et al. Granger causality analysis of steady-state electroencephalographic signals during propofol-induced anaesthesia[J]. PLoS ONE, 2012, 7(1): e29072. [17] Blinowska KJ, Ku R, Kamiński M. Granger causality and information flow in multivariate processes[J]. Physical Review E, 2004, 70(5): 050902. [18] Fagiolo G, Reyes J, Schiavo S. The evolution of the world trade web: a weighted-network analysis[J]. Journal of Evolutionary Economics, 2010, 20(4): 479-514. [19] Ye F, Lou XY, Sun LF. An improved chaotic fruit fly optimization based on a mutation strategy for simultaneous feature selection and parameter optimization for SVM and its applications[J]. PLoS ONE, 2017, 12(4): e0173516. [20] Chang CC, Lin CJ. LIBSVM: a library for support vector machines[J]. ACM Transactions on Intelligent Systems and Technology, 2011, 2(3): 1-27. [21] Gärtner M, Grimm S, Bajbouj M. Frontal midline theta oscillations during mental arithmetic: effects of stress[J]. Frontiers in Behavioral Neuroscience, 2015,9: 96. [22] Gärtner M, Rohde-Liebenau L, Grimm S, et al. Working memory-related frontal theta activity is decreased under acute stress[J]. Psychoneuroendocrinology, 2014, 43: 105-113. [23] Wianda E, Ross B. The roles of alpha oscillation in working memory retention[J]. Brain and Behavior, 2019, 9(4): e01263. [24] Trübutschek D, Marti S, Ojeda A, et al. A theory of working memory without consciousness or sustained activity[J]. Elife, 2017, 6: e23871. [25] Wang L, Liu X, Guise KG, et al. Effective connectivity of the fronto-parietal network during attentional control[J]. Journal of Cognitive Neuroscience, 2010, 22(3): 543-553. [26] Fletcher PC, Henson RNA. Frontal lobes and human memory: insights from functional neuroimaging[J]. Brain, 2001, 124(5): 849-881. [27] 王婷婷, 莫雷, 舒斯云. 记忆编码与提取过程的脑机制-功能性核磁共振研究[J]. 生理学报, 2009, 61(5): 395-403. [28] Olson IR, Berryhill M. Some surprising findings on the involvement of the parietal lobe in human memory[J]. Neurobiology of Learning and Memory, 2009, 91(2): 155-165. [29] Jonides J, Reuter-Lorenz PA, Smith EE, et al. Verbal and spatial working memory in humans[J]. Psychology of Learning & Motivation, 1996, 35(8):43-88. [30] Hung Y, Smith ML, Taylor MJ. Functional dissociations in prefrontal-hippocampal working memory systems[J]. Cortex, 2013, 49(4): 961-967.
