Research on Federated Learning-Based SSVEP Frequency Recognition Algorithm
Li Jinfei1, Chen Jianbo1, Zhang Yangsong1#*, Xu Peng1,2
1(School of Computer Science and Technology, Southwest University of Science and Technology, Mianyang 621000, Sichuan, China) 2(School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China)
Abstract：Steady-state visual evoked potential (SSVEP) is widely used in brain-computer interface (BCI) applications due to its high signal-to-noise ratio and stability. Currently, frequency recognition algorithms for SSVEP based on deep learning are facing the challenge of insufficient data. Effective training models using multi-center data has emerged as a potential solution. In this paper, a federated learning algorithm framework FLSSVEP for SSVEP recognition algorithm was proposed, which realized the joint training of models on different clients, and avoided the violation of data privacy while using more training data, so as to alleviate the impact of insufficient data or data dispersion on the model training. To verify the effectiveness of the proposed algorithm framework, comprehensive experiments were conducted on two public datasets of Benchmark and BETA by using EEGNet, CCNN, and SSVEP Former as the baseline models. Experimental results showed that the proposed FLSSVEP led to an average improvement of 33.82% in classification accuracy for these baseline models on one client, while the other two clients achieved average improvements of 8.13% and 6.05% in classification accuracy, respectively, better than those obtained from traditional local data training methods. This study demonstrated the effectiveness of federated learning in designing algorithms for SSVEP-based BCI, providing a theoretical reference for future research.
[1] Yin Erwei, Zeyl T, Saab R, et al.An auditory-tactile visual saccade-independent P300 brain-computer interface[J].International Journal of Neural Systems, 2016, 26(1): 1650001. [2] Yin Eewei, Zhou Zongtan, Jiang Jun, et al.A dynamically optimized SSVEP brain-computer interface (BCI) speller[J].IEEE Transactions on Biomedical Engineering, 2014, 62(6): 1447-1456. [3] Yin Eewei, Zhou Zongtan, Jiang Jun, et al.A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm[J].Journal of Neural Engineering, 2013, 10(2): 026012. [4] Pan Yudong, Chen Jianbo, Zhang Yangsong.A Survey of deep learning-based classification methods for steady-state visual evoked potentials[J].Brain-Apparatus Communication: A Journal of Bacomics, 2023, 2(1):2181102. [5] Zhang Yue, Xie Shane, Wang He, et al.Data analytics in steady-state visual evoked potential-based brain-computer interface: a review[J].IEEE Sensors Journal, 2020, 21(2): 1124-1138. [6] Lin Zhonglin, Zhang Changshu, Wu Wei, et al.Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs[J].IEEE Transactions on Biomedical Engineering, 2006, 53(12): 2610-2614. [7] Zhang Yongsong, Xu Peng, Cheng Kaiwen, et al.Multivariate synchronization index for frequency recognition of SSVEP-based brain-computer interface[J].Journal of Neuroscience Methods, 2014, 221: 32-40. [8] Chen Xiaogang, Wang Yijun, Gao Shangkai, et al.Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain-computer interface[J].Journal of Neural Engineering, 2015, 12(4): 046008. [9] Nakanishi M, Wang Yijun, Chen Xiaogang, et al.Enhancing detection of SSVEPs for a high-speed brain speller using task-related Component analysis[J].IEEE Transactions on Biomedical Engineering,2018,65(1): 104-112. [10] Zhang Yangsong, Guo Daqing, Li Fali, et al.Correlated component analysis for enhancing the performance of SSVEP-based brain-computer interface[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering.2018, 26(5): 948-956. [11] Liu Bingchuan, Chen Xiaogang, Shi Nanlin, et al.Improving the performance of individually calibrated SSVEP-BCI by task-discriminant component analysis[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2021, 29: 1998-2007. [12] Zhang Yangsong, Yin Erwei,Li Fali, et al.Hierarchical feature fusion framework for frequency recognition in SSVEP-based BCIs[J].Neural Networks, 2019, 119: 1-9. [13] Sun Qiang, Chen Minyou, Zhang Li, et al.Similarity-constrained task-related component analysis for enhancing SSVEP detection[J].Journal of Neural Engineering, 2021, 18(4): 046080. [14] 杨满,钟子平,韩锦,等.稳态视觉诱发电位解码算法研究综述[J].生物医学工程学杂志,2022,39(2):416-425. [15] Waytowich N, Lawhern VJ, Garcia JO, et al.EEGNet:a compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials[J].Journal of Neural Engineering, 2018, 15(6): 066031. [16] Ravi A, Beni NH, Manuel J, et al.Comparing user-dependent and user-independent training of CNN for SSVEP BCI[J].Journal of Neural Engineering, 2020, 17(2): 026028. [17] 丛佩超, 陈熙来, 肖宜轩,等.基于SSVEP信号的相频特性分类算法研究[J].电子测量技术, 2024, 47 (5): 188-198. [18] Chen Jianbo, Zhang Yangsong, Pan Yudong, et al.A transformer-based deep neural network model for SSVEP classification[J].Neural Networks,2022,164: 521-534 . [19] Zhang Kaiyue, Song Xuan, Zhang Chenhan, et al.Challenges and future directions of secure federated learning: a survey[J].Frontiers of Computer Science, 2021, 16(5): 165817. [20] 张轶凡.基于生成对抗网络的联邦学习隐私保护研究[D].南京: 南京理工大学, 2022. [21] Li Li, Fan Yuxi, Tse M, et al.A review of applications in federated learning[J].Computers & Industrial Engineering, 2020, 149: 106854. [22] Gao Dashan, Ju Ce, Wei Xiguang, et al.Hhhfl: hierarchical heterogeneous horizontal federated learning for electroencephalography[J/OL].https://arxiv.org/abs/1909.05784,2020-09-11/2025-09-09. [23] Gao Dashan, Liu Yang, Huang Anbu, et al.Privacy-preserving heterogeneous federated transfer learning[C]//2019 IEEE International Conference on Big data (Big Data).Piscataway:IEEE, 2019: 2552-2559. [24] Ju Ce, Gao Dashan, Mane R, et al.Federated transfer learning for EEG signal classification[C]//2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).Montreal:IEEE, 2020: 3040-3045. [25] Hang Wenlong, Li Jiaxing, Liang Shuang, et al.FedEEG: Federated EEG decoding via inter-subject structure matching[C]//ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).Piscataway:IEEE, 2023: 1-5. [26] Liu Rui, Chen Yuanyuan, Li Anran, et al.Aggregating intrinsic information to enhance BCI performance through federated learning[J].Neural Networks, 2024, 172: 106100. [27] Wang Yijun, Chen Xiaogang, Gao Xiaorong, et al.A benchmark dataset for SSVEP-based brain-computer interfaces[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016, 25(10): 1746-1752. [28] Liu Bingchuan, Huang Xiaoshan, Wang Yijun, et al.BETA: a large benchmark database toward SSVEP-BCI application[J].Frontiers in Neuroscience, 2020, 14: 544547. [29] Mcmahan B, Moore E, Ramage D, et al.Communication-efficient learning of deep networks from decentralized data[C]//Proceedings of the 20th International Conference on Artificial Intelligence and Statistics.Brookline:PMLR,2017: 1273-1282. [30] Li Tian, Sahu AK, Zaheer M, et al.Federated optimization in heterogeneous networks[J].Proceedings of Machine Learning and Systems, 2020, 2: 429-450. [31] Mu Xutong, Shen Yulong, Cheng Ke, et al.Fedproc: prototypical contrastive federated learning on non-iid data[J].Future Generation Computer Systems, 2023, 143: 93-104. [32] Hsu TH, Qi Hang, Brown M.Measuring the effects of non-identical data distribution for federated visual classification[J/OL].https://arxiv.org/abs/1909.06335,2019-09-13/2025-09-09.
