EEG Signal Recognition of VR Education Game Players Based on Hybrid Improved Wavelet Threshold and LSTM
According to Electroenc-Encephalo-Graphy (EEG) signal correlation analysis, attention levels of game players can objectively reflect changes in attention during Virtual Reality (VR) education games. To avoid noise interference, denoising processing is necessary. This study improves the traditional wavelet thresholding method by combining it with Ensemble Empirical Mode Decomposition (EEMD). Then, feature extraction is performed to remove noise and identify EEG features related to attention, which are classified using long short-term memory techniques. The proposed method is validated through experimental design, showing minimal root mean square error of 12.0231 and maximum signal-to-noise ratio of 11.3272, indicating effective denoising. In VR, attention is more focused and stable compared to the 3D environment. Time required to achieve challenge goals is 53.65 seconds in VR and 65.7 seconds in 3D environments, suggesting participants achieve goals earlier in VR. The correlation coefficient between VR and 3D environment is 0.784, indicating a strong correlation, with a Significant Difference (SD) in time required to achieve initial goals. The proposed method demonstrates effectiveness in EEG signal recognition.
[1] Ahmad I., Zhang S., Saminu S., Wang L., Isselmou A., Cai Z., Javaid I., Kamhi S., and Kulsum U., “Deep Learning Based on CNN for Emotion Recognition Using EEG Signal,” WSEAS Transactions on Signal Processing, vol. 17, pp. 28-40, 2021. https://wseas.com/journals/articles.php?id=329
[2] Bakhshali M., Khademi M., Ebrahimi-Moghadam A., and Moghimi S., “EEG Signal Classification of Imagined Speech Based on Riemannian Distance of Correntropy Spectral Density,” Biomedical Signal Processing and Control, vol. 59, pp. 101899, 2020. https://doi.org/10.1016/j.bspc.2020.101899
[3] Chai M. and Ba L., “Application of EEG Signal Recognition Method Based on Duffing Equation in Psychological Stress Analysis,” Advances in Mathematical Physics, vol. 2021, no. 1, pp. 1-10, 2021. https://doi.org/10.1155/2021/1454547
[4] Chen Z., “Signal Recognition for English Speech Translation Based on Improved Wavelet Denoising Method,” Advances in Mathematical Physics, vol. 2021, no. 1, pp. 1-9, 2021. https://doi.org/10.1155/2021/6811192
[5] Cheng X. and Zhang P., “Enhanced Soccer Training Simulation Using Progressive Wasserstein GAN and Termite Life Cycle Optimization in Virtual Reality,” The International Arab Journal of Information Technology, vol. 21, no. 4, pp. 549-559, 2024. DOI: 10.34028/iajit/21/4/1
[6] Cheng X., Mao J., Li J., Zhao H., Zhou C., Gong X., and Rao Z., “An EEMD-SVD-LWT Algorithm for Denoising a Lidar Signal,” Measurement, vol. 168, no, 3, pp. 108405, 2021. https://doi.org/10.1016/j.measurement.2020.108405
[7] Dao F., Zeng Y., and Qian J., “A Novel Denoising Method of the Hydro-Turbine Runner for Fault Signal Based on WT-EEMD,” Measurement, vol. 219, no. 1, pp. 1-16, 2023. https://doi.org/10.1016/j.measurement.2023.113306
[8] Dong Y. and Ren F., “Multi-Reservoirs EEG Signal Feature Sensing and Recognition Method Based on Generative Adversarial Networks,” Computer Communications, vol. 164, no. 6, pp. 177-184, 2020. https://doi.org/10.1016/j.comcom.2020.10.004
[9] Ge J., Niu T., Xu D., Yin G., Wang Y., “A Rolling Bearing Fault Diagnosis Method Based on EEMD-WSST Signal Reconstruction and Multi- Scale Entropy,” Entropy, vol. 22, no. 3, pp. 290- 291, 2020. DOI: 10.3390/e22030290
[10] Jana G., Sabath A., and Agrawal A., “Capsule Neural Networks on Spatio-Temporal EEG Frames for Cross-Subject Emotion Recognition,” Biomedical Signal Processing and Control, vol. 72, pp. 1-16, 2022. DOI:10.1016/j.bspc.2021.103361
[11] Javidan M., Yazdchi M., Baharlouei Z., and Mahnam A., “Feature and Channel Selection for Designing a Regression-based Continuous- Variable Emotion Recognition System with two EEG Channels,” Biomedical Signal Processing and Control, vol. 70, no. 7, pp. 102979, 2021. https://doi.org/10.1016/j.bspc.2021.102979
[12] Jiang H., Wang Z., Jiao R., and Jiao S., “Picture- Induced EEG Signal Classification Based on CVC Emotion Recognition System,” Computers, Materials and Continua, vol. 65, no. 2, pp. 1453- 1465, 2020. DOI:10.32604/cmc.2020.011793
[13] Liu N., Zhang R., Su Z., Fu G., and He J., “Research on Wavelet Threshold Denoising Method for UWB Tunnel Personnel Motion Location,” Mathematical Problems in Engineering, vol. 2020, no. 1, pp. 1-14, 2020. https://doi.org/10.1155/2020/9039648
[14] Meng X., Qiu S., Wan S., Cheng K., and Cui L., “A Motor Imagery EEG Signal Classification Algorithm Based on Recurrence Plot Convolution Neural Network,” Pattern Recognition Letters, vol. 146, no. 4, pp. 134-141, 2021. DOI:10.1016/j.patrec.2021.03.023 EEG Signal Recognition of VR Education Game Players Based on Hybrid Improved Wavelet ... 181
[15] Naser D. and Saha G., “Influence of Music Liking on EEG Based Emotion Recognition,” Biomedical Signal Processing and Control, vol. 64, pp. 1-15, 2021. DOI:10.1016/j.bspc.2020.102251
[16] Parija S., Dash P., and Bisoi R., “Multi-Kernel Based Random Vector Functional Link Network with Decomposed Features for Epileptic EEG Signal Classification,” IET Signal Process, vol. 14, no. 3, pp. 162-174, 2020. https://doi.org/10.1049/iet-spr.2019.0277
[17] Priyadarshini B. and Reddy D., “Optimized Adaptive Neuro Fuzzy Inference System (OANFIS) Based EEG Signal Analysis for Seizure Recognition on FPGA,” Biomedical Signal Processing and Control, vol. 66, no. 8, pp. 601-615, 2021. https://doi.org/10.1016/j.bspc.2021.102484
[18] Salankar N., Mishra P., and Garg L., “Emotion Recognition from EEG Signals Using Empirical Mode Decomposition and Second-Order Difference Plot,” Biomedical Signal Processing and Control, vol. 65, no. 8, pp. 1-13, 2021. https://doi.org/10.1016/j.bspc.2020.102389
[19] Subasi A., Tuncer T., Dogan S., Tanko D., and Sakoglu U., “EEG-based Emotion Recognition Using Tunable Q Wavelet Transform and Rotation Forest Ensemble Classifier,” Biomedical Signal Processing and Control, vol. 68, pp. 102648, 2021. https://doi.org/10.1016/j.bspc.2021.102648
[20] Thakran S., “A Hybrid GPFA-EEMD_Fuzzy Threshold Method for ECG Signal De-Noising,” Journal of Intelligent and Fuzzy Systems, vol. 39, no. 5, pp. 6773-6782, 2020. DOI:10.3233/JIFS- 191518
[21] Tong Y., Li J., Xu Y., and Cao L., “Signal Denoising Method Based on Improved Wavelet Threshold Function for Microchip Electrophoresis C4D Equipment,” Complexity, vol. 2020, no. 1, pp. 1-11, 2020. https://doi.org/10.1155/2020/6481317
[22] Tuncer T., Dogan S., and Acharya U., “Automated EEG Signal Classification Using Chaotic Local Binary Pattern,” Expert Systems with Applications, vol. 182, no. 1, pp. 115175, 2021. https://doi.org/10.1016/j.eswa.2021.115175
[23] Wang J., Sun Y., and Sun S., “Recognition of Muscle Fatigue Status Based on Improved Wavelet Threshold and CNN-SVM,” IEEE Access, vol. 8, pp. 207914-207922, 2020. DOI:10.1109/ACCESS.2020.3038422
[24] Wankhade S. and Doye D., “Deep Learning of Empirical Mean Curve Decomposition-Wavelet Decomposed EEG Signal for Emotion Recognition,” International Journal of Uncertainty, Fuzziness and Knowledge-based Systems, vol. 28, no. 1, pp. 153-177, 2020. https://doi.org/10.1142/S0218488520500075
[25] Wei M. and Lin F., “A Novel Multi-Dimensional Features Fusion Algorithm for the EEG Signal Recognition of Brain’s Sensorimotor Region Activated Tasks,” International Journal of Intelligent Computing and Cybernetics, vol. 13, no. 2, pp. 239-360, 2020. https://doi.org/10.1108/IJICC-02-2020-0019
[26] Wei P., Zhang J., Tian F., and Hong J., “A Comparison of Neural Networks Algorithms for EEG and sEMG Features Based Gait Phases Recognition,” Biomedical Signal Processing and Control, vol. 68, pp. 102587, 2021. https://doi.org/10.1016/j.bspc.2021.102587
[27] Yu M., Xiao S., Hua M., Wang H., Chen X., Tian F., and Li Y., “EEG-based Emotion Recognition in an Immersive Virtual Reality Environment: From Local Activity to Brain Network Features,” Biomedical Signal Processing and Control, vol. 72, pp. 1-13, 2022. DOI:10.1016/j.bspc.2021.103349
[28] Zhang S., Zhou L., Chen X. M., Zhang L., Li L., and Li M., “Network-Wide Traffic Speed Forecasting: 3D Convolutional Neural Network with Ensemble Empirical Mode Decomposition,” Computer-Aided Civil and Infrastructure Engineering, vol. 35, no. 10, pp. 1132-1147, 2020. https://doi.org/10.1111/mice.12575
[29] Zhu J., Feng L., and Mo X., “Robust Multichannel EEG Signal Reconstruction Method,” Pattern Recognition Letters, vol. 151, pp. 209-214, 2021. DOI:10.1016/j.patrec.2021.08.014