Abstract：In recent years, the test-retest reliability of EEG has been increasingly emphasized in the exploration of the cognitive neural mechanisms of psychological processes based on scalp electroencephalography (EEG). When developing experimental methods based on scalp EEG to evaluate human brain function, researchers are increasingly concerned about whether these methods are highly reliable. Starting from the main factors that affect the test-retest reliability of EEG, we focused on the impact of the basic experimental process of EEG on the test-retest reliability. Firstly, the commonly used methods for measuring the test-retest reliability of EEG were introduced. Then, from the perspective of experimental methods, the research progress in this field was reviewed, including experimental design, data processing, feature selection, subject group, etc. The main focus was on the impact of data analysis methods on the test-retest reliability. It was pointed out that improving the signal-to-noise ratio of EEG signals and standardizing the preprocessing process are important ways to improve the test-retest reliability of EEG. Finally, ways to improve the test-retest reliability of EEG research were proposed based on the selection of experimental paradigms and features or indicators, and prospects for the development of EEG test-retest research were presented.
覃慧怡, 汪玉林, 雷旭. 头皮脑电重测信度的研究进展[J]. 中国生物医学工程学报, 2024, 43(1): 106-116.
Qin Huiyi, Wang Yulin, Lei Xu. Research Progress of Test-Retest Reliability Based on Scalp EEG. Chinese Journal of Biomedical Engineering, 2024, 43(1): 106-116.
[1] Salinsky MC, Oken BS, Morehead L.Test-retest reliability in EEG frequency analysis[J]. Electroencephalogr Clin Neurophysiol, 1991, 79: 382-392.
[2] 杨文俊. 事件相关电位[J].新医学,1999(5):52-54.
[3] Kohrman MH, Sugioka C, Huttenlocher PR, et al.Inter-subject versus intra-subject variance in topographic mapping of the electroencephalogram[J]. Clinical Electroencephalography, 1989, 20: 248-253.
[4] Lugo ZR, Pokorny C, Pellas F, et al.Mental imagery for brain-computer interface control and communication in non-responsive individuals[J]. Annals of Physical and Rehabilitation Medicine, 2020, 63: 21-27.
[5] Zuo Xinian, Xu Ting, Milham MP.Harnessing reliability for neuroscience research[J]. Nature Human Behaviour, 2019, 3: 768-771.
[6] Cassidy SM, Robertson IH, O'connell RG. Retest reliability of event-related potentials: evidence from a variety of paradigms[J]. Psychophysiology, 2012, 49: 659-664.
[7] Duan Wei, Chen Xinyuan, Wang Yajie, et al.Reproducibility of power spectrum, functional connectivity and network construction in resting-state EEG[J]. Journal of Neuroscience Methods, 2021, 348: 108985.
[8] Ding Lihong, Duan Wei, Wang Yajie, et al.Test-retest reproducibility comparison in resting and the mental task states: aa sensor and source-level EEG spectral analysis[J]. International Journal of Psychophysiology, 2022, 173: 20-28.
[9] Pollock VE, Schneider LS, Lyness SA.Reliability of topographic quantitative EEG amplitude in healthy late-middle-aged and elderly subjects[J]. Electroencephalogr Clin Neurophysiol, 1991, 79: 20-26.
[10] Burgess A, Gruzelier J.Individual reliability of amplitude distribution in topographical mapping of EEG[J]. Electroencephalogr Clin Neurophysiol, 1993, 86: 219-223.
[11] Fernandez T, Harmony T, Rodriguez M, et al.Test-retest reliability of EEG spectral parameters during cognitive tasks: I. Absolute and relative power[J]. The International Journal of Neuroscience, 1993, 68: 255-261.
[12] Mcevoy LK, Smith ME, Gevins A.Test-retest reliability of cognitive EEG[J]. Clinical Neurophysiology, 2000, 111: 457-463.
[13] Fallgatter AJ, Bartsch AJ, Strik WK, et al.Test-retest reliability of electrophysiological parameters related to cognitive motor control[J]. Clinical Neurophysiology, 2001, 112: 198-204.
[14] Corsi-cabrera M, Galindo-vilchis L, Del-río-portilla Y, et al. Within-subject reliability and inter-session stability of EEG power and coherent activity in women evaluated monthly over nine months[J]. Clinical Nneurophysiology, 2007, 118: 9-21.
[15] Friedrich EVC, Scherer R, Neuper C.Stability of event-related (de-) synchronization during brain-computer interface-relevant mental tasks[J]. Clinical Neurophysiology, 2013, 124: 61-69.
[16] Khanna A, Pascual-leone A, Farzan F. Reliability of resting-state microstate features in electroencephalography[J]. PLoS ONE, 2014, 9: 21.
[17] Suarez-revelo J, Ochoa-gomez J, Duque-grajales J. Improving test-retest reliability of quantitative electroencephalography using different preprocessing approaches[C] //The 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Orlando: IEEE, 2016: 961-964.
[18] Vazquez-marrufo M, Galvao-carmona A, Lugo MLB, et al. Retest reliability of individual alpha ERD topography assessed by human electroencephalography[J]. PLoS ONE, 2017, 12: 15.
[19] Moezzi B, Hordacre B, Berryman C, et al. Test-retest reliability of functional brain network characteristics using resting-state EEG and graph theory [DB/OL]. https://doi.org/10.1101/385302, 2018-08-05/2021-12-30.
[20] 王瑶瑶. 持续注意行为指标的重测信度及其神经电生理机制研究 [D]. 杭州:杭州师范大学, 2020.
[21] Vazquez-marrufo M, Caballero-diaz R, Martin-clemente R, et al. Individual test-retest reliability of evoked and induced alpha activity in human EEG data[J]. PLoS ONE, 2020, 15: 17.
[22] Dien J, Michelson CA, Franklin MS.Separating the visual sentence N400 effect from the P400 sequential expectancy effect: cognitive and neuroanatomical implications[J]. Brain Research, 2010, 1355: 126-140.
[23] Cannon RL, Baldwin DR, Shaw TL, et al.Reliability of quantitative EEG (qEEG) measures and LORETA current source density at 30 days[J]. Neuroscience Letters, 2012, 518: 27-31.
[24] Glenville M, Broughton R, Wing AM, et al.Effects of sleep deprivation on short duration performance measures compared to the Wilkinson auditory vigilance task[J]. Sleep, 1978, 1: 169-176.
[25] Lisper HO, Kjellberg A.Effects of 24-hour sleep deprivation on rate of decrement in a 10-minute auditory reaction time task[J]. Journal of Experimental Psychology, 1972, 96: 287-290.
[26] Shirk SD, Mclaren DG, Bloomfield JS, et al.Inter-rater reliability of preprocessing EEG Data: impact of subjective artifact removal on associative memory task ERP results[J]. Frontiers in Neuroscience, 2017, 11: 322.
[27] Vecchio F, Babiloni C, Lizio R, et al.Resting state cortical EEG rhythms in Alzheimer's disease: toward EEG markers for clinical applications: a review[J]. Supplements to Clinical Neurophysiology, 2013, 62: 223-236.
[28] Lin MH, Davies PL, Stephens J, et al.Test-retest reliability of electroencephalographic measures of performance monitoring in children and adults[J]. Developmental Neuropsychology, 2020, 45: 341-366.
[29] Corsicabrera M, Herrera P, Malvido M.Correlation between EEG and cognitive-abilities-sex-differences[J]. International Journal of Neuroscience, 1989, 45: 133-141.
[30] Mcewen BS, Alves SE, Bulloch K, et al.Ovarian steroids and the brain: implications for cognition and aging[J]. Neurology, 1997, 48: S8-S15.
[31] Stachtea X, Zioga I, Giannopoulos AE, et al.Test-retest reliability of brain oscillations in a prepulse inhibition and facilitation paradigm: effects of gender in healthy humans[J]. Neuroreport, 2020, 31: 985-990.
[32] Giannitrapani D, Liberson WT.The electrophysiology of intellectual functions[M].Basel: Karger, 1985.
[33] Kuntzelman K, Miskovic V.Reliability of graph metrics derived from resting-state human EEG[J]. Psychophysiology, 2017, 54: 51-61.
[34] Ratcliff R, Philiastides MG, Sajda P.Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG[J]. Proceedings of the National Academy of Sciences of the United States of America, 2009, 106: 6539-6544.
[35] Vanrullen R, Busch NA, Drewes J, et al.Ongoing EEG phase as a trial-by-trial predictor of perceptual and attentional variability[J]. Frontiers in Psychology, 2011, 2: 60.
[36] Delorme A, Makeig S.EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis[J]. Journal of Neuroscience Methods, 2004, 134: 9-21.
[37] Bigdely-shamlo N, Mullen T, Kothe C, et al. The PREP pipeline: standardized preprocessing for large-scale EEG analysis[J]. Frontiers in Neuroinformatics, 2015, 9: 16.
[38] Klimesch W, Sauseng P, Hanslmayr S.EEG alpha oscillations: the inhibition-timing hypothesis[J]. Brain Research Reviews, 2007, 53: 63-88.
[39] Uusberg A, Uibo H, Kreegipuu K, et al.EEG alpha and cortical inhibition in affective attention[J]. International Journal of Psychophysiology, 2013, 89: 26-36.
[40] Mcloughlin G, Palmer J A, Rijsdijk F, et al.Genetic overlap between evoked frontocentral theta-band phase variability, reaction time variability, and attention-deficit/hyperactivity disorder symptoms in a twin study[J]. Biological Psychiatry, 2014, 75: 238-247.
[41] Pandey AK, Kamarajan C, Manz N, et al.Delta, theta, and alpha event-related oscillations in alcoholics during Go/NoGo task: neurocognitive deficits in execution, inhibition, and attention processing[J]. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 2016, 65: 158-171.
[42] Lehmann D, Michel CM, Pal I, et al.Event-related potential maps depend on prestimulus brain electric microstate map[J]. The International Journal oof Neuroscience, 1994, 74: 239-248.
[43] Goodhew SC, Edwards M.Translating experimental paradigms into individual-differences research: Contributions, challenges, and practical recommendations[J]. Consciousness and Cognition, 2019, 69: 14-25.
[44] Botvinik-nezer R, Holzmeister F, Camerer CF, et al. Variability in the analysis of a single neuroimaging dataset by many teams[J]. Nature, 2020, 582: 84-88.
[45] Carver T, Harris SR, Berriman M, et al.Artemis: an integrated platform for visualization and analysis of high-throughput sequence-based experimental data[J]. Bioinformatics, 2012, 28: 464-469.
[46] Pernet CR, Appelhoff S, Gorgolewski KJ, et al.EEG-BIDS, an extension to the brain imaging data structure for electroencephalography[J]. Scientific Data, 2019, 6: 5.
