EEG Signal Analysis of Fatigue Caused by Virtual Reality Immersive Visual Experience
Wang Lei1,2, Zhang Tianheng1,2, Guo Miaomiao1,2*, Xu Guizhi1,2#
1(State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, China) 2(Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, Hebei University of Technology, Tianjin 300130, China)
Abstract:Virtual reality (VR) is a computer technology that generates realistic images, sounds and other sensations that simulate a user′s physical presence in a virtual environment. With the rapid development of virtual reality technique, brain fatigue caused by VR has raised concerns. In this work, 16 healthy subjects were recruited, and EEG signals were acquired synchronously while the subjects were watching videos in similar types presented by traditional displayer and virtual reality separately. Two questionnaires were conducted by all subjects to evaluate the state of fatigue before and after the experiment. We also compared the relative energy of alpha, beta, delta and theta band during two experiments. What′s more, the fatigue factor and center of gravity were analyzed. Results showed that in the VDT and SPFS questionnaires, the average score was 0.44±0.22 and 3.28±1.03 after watching virtual reality video, which was higher than 0.31±0.20 and 2.26±0.98 after watching traditional plane video, with a significant difference (P<0.05). And from the EEG signals’ results, significantly at the temporal lobe area, after watching the VR video, the alpha band energy decreased (before: 0.249±0.007, after: 0.234±0.005, P<0.05) and the value of gravity frequency decreased (before: 7.545±0.950 Hz, after: 3.717±0.398 Hz, P<0.05) while the delta band energy increased (before: 0.295±0.012, after: 0.314±0.007, P<0.05), and moreover, the variation trend of these parameters was significantly different from that after watching traditional plane video, showing an opposite variation trend. Furthermore, the alpha band energy at the temporal lobe and parietal lobe area decreased during watching VR video, while the beta band energy decreased following the initial increase. These results indicated that watching VR videos was more likely to induce subjective fatigue and the changes of rhythm activity in characteristic frequency band of EEG signals, providing theoretical basis for objective evaluation of brain fatigue caused by immersive experience of VR.
[1] Bailenson J, Patel K, Nielsen A, et al. The effect of interactivity on learning physical actions in virtual reality [J]. Media Psychology, 2008, 11(3): 354-376.
[2] Bailenson JN, Yee N, Blascovichb J, et al. The use of immersive virtual reality in the learning sciences: Digital transformations of teachers, students, and social context [J]. Journal of the Learning Sciences, 2008, 17(1): 102-141.
[3] Bohil CJ, Alicea B, Biocca FA. Virtual reality in neuroscience research and therapy [J]. Nature Reviews Neuroscience, 2011, 12: 752-762.
[4] Suzumura A. Visual fatigue [J]. Ganka, 1981, 23: 799-904.
[5] Zhang C, Zheng C, Yu X. Evaluation of mental fatigue based on multipsychophysiological parameters and kernel learning algorithms [J]. Chinese Science Bulletin, 2008, 53(12): 1847-1853.
[6] 刘建平,张崇,邓崇勋,等.基于多导脑电信号复杂性测度的脑疲劳分析[J].西安交通大学学报,2008,42 (12): 1555-1559.
[7] Kirschner A, Cruse D, Chennu S, et al. A P300-based cognitive assessment battery [J]. Brain and Behavior, 2015, 5(6): e00336.
[8] Vecchio F, Miraglia F, Quaranta D, et al. Cortical connectivity and memory performance in cognitive decline: A study via graph theory from EEG data [J]. Neuroscience, 2016, 316(1): 143-150.
[9] Jaiswal N, Ray W, Slobounov S. Encoding of visual-spatial information in working memory requires more cerebral efforts than retrieval: Evidence from an EEG and virtual reality study [J]. Brain Research, 2010, 1347(6):80-89.
[10] 李忠强,刑丽冬,于德飞,等.观看3D电视前后的脑电信号变化与电极层次性布局[J].中国生物医学工程学报,2013, 32(4): 433-439.
[11] Cho BH, Lee JM, Ku JH, et al. Attention enhancement system using virtual reality and EEG biofeedback [C]// Proceedings of the IEEE Virtual Reality Conference. Orlando: IEEE, 2002:156-163.
[12] Tran Y, Thuraisingham RA, Wijesuriya N, et al. Detecting neural changes during stress and fatigue effectively: A comparison of spectral analysis and sample entropy [C]// The 3rd International IEEE/EMBS in Neural Engineering. Kohala Coast: IEEE, 2007: 350-353.
[13] 吴绍斌,高利,王刘安.基于脑电信号的驾驶疲劳检测研究[J].北京理工大学学报,2009,29(12): 1703-1704.
[14] Zhang C, Zheng C, Pei X, et al. Power spectrum analysis on the multiparameter electroencephalogram features of physiological mental fatigue[J]. Journal of Biomedical Engineering, 2009, 26(1): 162-166.
[15] 李健,陈国镇,陈春晓. 基于脑电信号溯源分析的观看3D电视导致大脑疲劳研究[J].中国生物医学工程学报,2017, 36(1): 46-52.
[16] 李斌,王猛,汪林,等. 驾驶时间对营运驾驶员驾驶能力影响的试验研究[J].公路交通科技,2007, 24(5): 113-117.
[17] 谢晓莉. 驾驶疲劳生成机理研究[D].北京:北京工业大学,2010.
[18] 刘佳佳,王飞,洪炜,等. 立体视觉下人类大脑激活的功能核磁共振初步研究[J]. 北京师范大学学报,2013, 49(6):640-644.
[19] Janssen P, Vogels R, Liu Y, et al. Macaque inferior temporal neurons are selective for three-dimensional boundaries and surfaces [J]. Journal of Neuroscience, 2001, 21(23): 9419-9429.
[20] 张莉,徐亮,王笑,等. 应用脑电信号波评价观看3D视频对人视觉健康与疲劳影响的研究[J].眼科,2015, 24(5): 324-331.
[21] 杨硕,冀亚坤,王磊,等. 基于脑疲劳的Delta-Gamma相位幅值耦合研究[J].中国生物医学工程学报,2018, 37(4): 445-450.