A Novel Approach to Motor Imagery EEG Signal Transformation and Classification Using Stockwell Transform and Deep Learning Models
Öz
Motor imagery (MI) classification using EEG signals has gained popularity, playing an essential role in developing technologies such as brain-computer interfaces (BCIs). This paper proposes novel approaches using the Stockwell transform (S-transform) to encode signals into images in time-frequency space and classify them by feeding them to pre-trained Inception-ResNet-V2, AlexNet, and SqueezeNet CNNs. High subject-to-subject and session-to-session signal variability hinder the recognition of MI tasks. Most literature has studied within-subject performance. This study conducted experiments using a leave-one-subject-out cross-validation strategy, investigated inter-subject variation's effect and contributed by evaluating the model's performance and generalization ability. At the same time, different sessions and the presence or absence of feedback were assessed, and the results were analyzed. The results are encouraging, considering the difficulty of classifying MI and inter-subject differences. For a cue-based paradigm and non-feedback signals, the results are between 62.1-80.8%; for signals with smiley feedback, the results are between 57.1-96.3%; and for signals with and without feedback are between 56.8-91.4%. These findings highlight the potential of combining the S-transform with CNNs, offering valuable insights into inter-subject variability in EEG-based BCI applications.
Anahtar Kelimeler
Stockwell Transform, Convolutional Neural Networks, Transfer Learning, Motor Imagery, Brain-Computer Interfaces, Artificial Intelligence Software
Kaynakça
- Alwasiti, H., Yusoff, M. Z., Raza, K. (2020). Motor imagery classification for brain computer interface using deep metric learning. IEEE Access, 8, 109949-109963. doi.org/10.1109/ACCESS.2020.3002459
- Chacon-Murguia, M. I., Rivas-Posada, E. (2020, July). Feature extraction evaluation for two motor imagery recognition based on common spatial patterns, time-frequency transformations and SVM. In 2020 International Joint Conference on Neural Networks (IJCNN) (pp. 1-7). IEEE. https://doi.org/10.1109/IJCNN48605.2020.9206638
- Chang, H., Yang, J. (2018). Genetic-based feature selection for efficient motion imaging of a brain–computer interface framework. Journal of Neural Engineering, 15(5), 056020. https://doi.org/10.1088/1741-2552/aad567
- Das, M. K., Ari, S. (2013). Analysis of ECG signal denoising method based on S-transform. IRBM, 34(6), 362-370. https://doi.org/10.1016/j.irbm.2013.07.012
- Ferdi, A. Y., Ghazli, A. (2024). Authentication with a one-dimensional CNN model using EEG-based brain-computer interface. Computer Methods in Biomechanics and Biomedical Engineering, 1-12. https://doi.org/10.1080/10255842.2024.2355490
- Gibson, P., Lamoureux, M. Margrave, G. (2006) Letter to the Editor: Stockwell and Wavelet Transforms. J Fourier Anal Appl 12, 713–721. https://doi.org/10.1007/s00041-006-6087-9
- Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size. arXiv preprint arXiv:1602.07360. https://arxiv.org/abs/1602.07360
- Kalbkhani, H., Shayesteh, M. G. (2017). Stockwell transform for epileptic seizure detection from EEG signals. Biomedical Signal Processing and Control, 38, 108-118. https://doi.org/10.1016/j.bspc.2017.05.008
- Krizhevsky, A., Sutskever, I., Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90. https://doi.org/10.1145/3065386
- Luo, T. -J. (2022) Dual regularized feature extraction and adaptation for cross-subject motor imagery EEG classification. IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (pp. 1092-1099) IEEE. https://doi.org/10.1109/BIBM55620.2022.9995282
kapsamında lisanslanmıştır.