A Study of Motion Sickness Detection Based on Source Space Functional Connectivity Analysis
Hua Chengcheng1,2,3*, Zhou Zhanfeng1, Chai Lining1, Liu Jia1,2,3
1(School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China) 2(Intelligent Weather Detection Robot Engineering Research Center of Jiangsu Province, Nanjing 210044, China) 3(Jiangsu Province Collaborative Innovation Center for Atmospheric Environment and Equipment Technology, Nanjing 210044, China)
Abstract:Virtual reality motion sickness (VRMS) is a key factor hindering the development of the virtual reality (VR) industry. To mitigate the adverse user experiences and health risks associated with VRMS, it is essential to detect its onset. This study explored the neural mechanisms underlying VRMS by analyzing the functional connectivity in the brain’s cortical regions, aiming to provide effective biomarkers for VRMS detection. The research employed frequency-domain source localization, phase lag index (PLI) calculation, and graph theory-based quantification of brain functional networks to extract electroencephalogram (EEG) features related to VRMS. The PLI results indicated significant differences in the connectivity strength within the theta and alpha frequency bands between VRMS and normal states (P<0.05). Additionally, graph theory metrics showed a significant increase in the node efficiency and transitivity in the theta band (P<0.01) and a significant increase in the clustering coefficient and node efficiency in the alpha band (P<0.01) during VRMS episodes. Finally, support vector machine (SVM) classification was applied to a dataset of 400 samples, the validity of these features was demonstrated with an average AUC of 0.97 and an average accuracy of 94.40%. These results suggested that source-space functional connectivity analysis might serve as an effective indicator for detecting VRMS.
化成城, 周占峰, 柴立宁, 刘佳. 基于源空间功能连通性分析的虚拟现实晕动症检测研究[J]. 中国生物医学工程学报, 2025, 44(3): 267-278.
Hua Chengcheng, Zhou Zhanfeng, Chai Lining, Liu Jia. A Study of Motion Sickness Detection Based on Source Space Functional Connectivity Analysis. Chinese Journal of Biomedical Engineering, 2025, 44(3): 267-278.
[1] Liu R, Zhuang C, Yang R, et al. Effect of economically friendly acustimulation approach against cybersickness in video-watching tasks using consumer virtual reality devices[J]. Appl Ergon, 2020, 8(2): 102-116. [2] Yang Z, Ren H. Feature extraction and simulation of EEG signals during exercise-induced fatigue[J]. IEEE Access, 2019, 7(6): 89-98. [3] 张冠华, 余旻婧, 陈果, 等. 面向情绪识别的脑电特征研究综述[J]. 中国科学:信息科学, 2019, 49(9): 97-118. [4] Gursel Ozmen N, Gumusel L, Yang Y. A biologically inspired approach to frequency domain feature extraction for EEG classification[J]. Comput Math Methods Med, 2018, 20: 98-112. [5] Chen YC, Duann JR, Chuang SW, et al. Spatial and temporal EEG dynamics of motion sickness[J]. Neuroimage, 2010, 49(3): 62-70. [6] Lim HK, Ji K, Woo YS, et al. Test-retest reliability of the virtual reality sickness evaluation using electroencephalography (EEG)[J]. Neurosci Lett, 2021, 74(3): 80-89. [7] 王磊, 张天恒, 郭苗苗, 等. 虚拟现实沉浸式视觉体验引起脑疲劳的脑电信号分析[J]. 中国生物医学工程学报, 2020, 39(2): 16-28. [8] Miljevic A, Bailey NW, Vila-Rodriguez F, et al. Electroencephalographic connectivity: a fundamental guide and checklist for optimal study design and evaluation[J]. Biological Psychiatry-Cognitive Neuroscience and Neuroimaging, 2022, 7(6): 546-554. [9] Shen M, Wen P, Song B, et al. Detection of alcoholic EEG signals based on whole brain connectivity and convolution neural networks[J]. Biomedical Signal Processing and Control, 2023, 79: 104242. [10] Gao X, Huang W, Liu Y, et al. A novel robust Student’s t-based Granger causality for EEG based brain network analysis[J]. Biomedical Signal Processing and Control, 2023, 80: 104321. [11] Henderson CJ, Butler SR, Glass A. The localization of equivalent dipoles of EEG sources by the application of electrical field theory[J]. Electroencephalography and Clinical Neurophysiology, 1975, 39(2): 117-130. [12] Sajib S, Yakov I, Murat Tahtali, et al. Evaluation of spatial resolution and noise sensitivity of sLORETA method for EEG source localization using low-density headsets[J]. Medical Physics, 2014, 6: 31-37. [13] Avni P, Herbert B. Localization of simultaneous multiple sources using SMS-LORETA[J]. Quantitative Methods, 2011, 10: 24-29. [14] 樊豪. 虚拟环境下镜像神经元和感觉运动皮层功能整合的研究[D]. 杭州: 杭州电子科技大学, 2022. [15] Fan H, Luo Z. Functional integration of mirror neuron system and sensorimotor cortex under virtual self-actions visual perception[J]. Behavioural Brain Research, 2022, 423: 784-795. [16] Kennedy RS, Lane NE, Berbaum KS, et al. Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness[J]. The International Journal of Aviation Psychology, 1993, 3(3): 203-220. [17] Canuet L, Ishii R, Pascual-Marqui RD, et al. Resting-state EEG source localization and functional connectivity in schizophrenia-like psychosis of epilepsy[J]. PLoS ONE, 2011, 6(11): 1300-1319. [18] Lanfer B, Scherg M, Dannhauer M, et al. Influences of skull segmentation inaccuracies on EEG source analysis[J]. NeuroImage, 2012, 62(1): 418-431. [19] Fuchs M, Kastner J, Wagner M, et al. A standardized boundary element method volume conductor model[J]. Clinical Neurophysiology, 2002, 113(5): 702-712. [20] Hamalainen MS, Sarvas J. Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data[J]. IEEE Transactions on Biomedical Engineering, 1989, 36(2): 165-171. [21] Ikeda S, Ishii R, Pascual-Marqui RD, et al. Automated source estimation of scalp EEG epileptic activity using eLORETA kurtosis analysis[J]. Neuropsychobiology, 2018, 77: 101-109. [22] Tao T, Lu SQ, Hu N, et al. Prognosis of comatose patients with reduced EEG montage by combining quantitative EEG features in various domains[J]. Frontiers in Neuroscience, 2023, 17: 1302318. [23] Hardmeier M, Hatz F, Bousleiman H, et al. Reproducibility of functional connectivity and graph measures based on the phase lag index (PLI) and weighted phase lag index (wPLI) derived from high resolution EEG[J]. PLoS ONE, 2014, 9(10): e108648. [24] Mikail R, Olaf S. Complex network measures of brain connectivity: uses and interpretations[J]. NeuroImage, 2010,52: 1059-1069. [25] 周占峰, 化成城, 柴立宁, 等. 基于脑电节律能量与模糊熵的VR诱发晕动症水平检测研究[J]. 数据采集与处理, 2024, 39(2): 490-500. [26] Saichand N V. Epileptic seizure detection using novel multilayer LSTM discriminant network and dynamic mode Koopman decomposition[J]. Biomedical Signal Processing and Control, 2021, 68: 102723. [27] Shu Gong, Kaibo Xing, Andrzej Cichocki, et al. Deep learning in EEG: advance of the last ten year critical period[J]. IEEE Transactions on Cognitive and Developmental Systems. 2022, 14(2): 348-365. [28] Lei M, Meng G, Zhang WM, et al. Sample entropy of electroencephalogram for children with autism based on virtual driving game[J]. Acta Physica Sinica, 2016, 65: 108701. [29] Wang Shuaishuai, Li Ying, Li Jipeng, et al. Research on the effect of background music on spatial cognitive working memory based on cortical brain network[J]. Journal of Biomedical Engineering, 2020, 37(4): 587-595. [30] Zhou Bing, Tan Changlian, Tang Jinsong, et al. Brain functional connectivity of functional magnetic resonance imaging of patients with early-onset schizophrenia[J]. Journal of Central South University Medical Sciences, 2010, 35(1): 17-24. [31] Hsu Chih-Wei, Lin Chih-Jen. A comparison of methods for multiclass support vector machines[J]. IEEE Transactions on Neural Networks, 2002, 13(2): 415-425.