Biometric Personal Classification with Deep Learning Using EMG Signals

Abstract

Biometric person recognition systems are becoming increasingly important due to their use in places requiring high security. Since it includes the physical and behavioral characteristics of people, the iris structure, which is a traditional person recognition system, is more secure than methods such as fingerprints or speech. In this study, a deep learning-based person classification/recognition model is proposed. The Gesture Recognition and Biometrics ElectroMyogram (GrabMyo) dataset from the open access PhysioNet database was used. With the 28-channel EMG device, 10 people were asked to make a fist movement with their hand. During the fist movement, data were recorded with the EMG device from the arm and wrist for 5 seconds with a sampling frequency of 2048. The EMD method was chosen to determine the spectral properties of EMG signals. With the EMD method, 4 IMF signal vectors were obtained from the high frequency components of the EMG signals. The classification performance effect of the feature vector is increased by using statistical methods for each IMF signal vector. Feature vectors are classified with CNN and LSTM methods from deep learning algorithms. Accuracy, Precision, Sensitivity and F-Score parameters were used to determine the performance of the developed model. An accuracy value of 95.57% was obtained in the model developed with the CNN method. In the LSTM method, the accuracy value was 93.88%. It is explained that the deep learning model proposed in this study can be effectively used as a biometric person recognition system for person recognition or classification problems with the EMG signals obtained during the fist movement. In addition, it is predicted that the proposed model can be used effectively in the design of future person recognition systems.

Keywords

• EMG
• Personal Classification
• Empirical Mode Decomposition
• CNN
• LSTM

References

1. A. Raurale, S., McAllister, J., & Del Rincon, J. M. (2020). Real-Time Embedded EMG Signal Analysis for Wrist-Hand Pose Identification. IEEE Transactions on Signal Processing, 68, 2713–2723. https://doi.org/10.1109/TSP.2020.2985299
2. Albaqami, H., Hassan, G. M., Subasi, A., & Datta, A. (2021). Automatic detection of abnormal EEG signals using wavelet feature extraction and gradient boosting decision tree. Biomedical Signal Processing and Control, 70, 102957. https://doi.org/10.1016/J.BSPC.2021.102957
3. Fan, J., Jiang, X., Liu, X., Zhao, X., Ye, X., Dai, C., Akay, M., & Chen, W. (2022). Cancelable HD-SEMG Biometric Identification via Deep Feature Learning. IEEE Journal of Biomedical and Health Informatics, 26(4), 1782–1793. https://doi.org/10.1109/JBHI.2021.3115784
4. Gaso, M. S., Cankurt, S., & Subasi, A. (2021). Electromyography Signal Classification Using Deep Learning. 2021 16th International Conference on Electronics Computer and Computation, ICECCO 2021. https://doi.org/10.1109/ICECCO53203.2021.9663803
5. Gui, Q., Ruiz-Blondet, M. V., Laszlo, S., & Jin, Z. (2019). A survey on brain biometrics. ACM Computing Surveys, 51(6). https://doi.org/10.1145/3230632
6. Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Snin, H. H., Zheng, Q., Yen, N. C., Tung, C. C., & Liu, H. H. (1998). The empirical mode decomposition and the Hubert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 454(1971), 903–995. https://doi.org/10.1098/rspa.1998.0193
7. Jamaluddin, F. N., Ibrahim, F., & Ahmad, S. A. (2023). A New Approach to Noninvasive-Prolonged Fatigue Identification Based on Surface EMG Time-Frequency and Wavelet Features. Journal of Healthcare Engineering, 2023, 13–16. https://doi.org/10.1155/2023/1951165
8. Kang, P., Jiang, S., & Shull, P. B. (2023). Synthetic EMG Based on Adversarial Style Transfer can Effectively Attack Biometric-based Personal Identification Models. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 31, 2022.10.14.512221. https://doi.org/10.1109/TNSRE.2023.3303316

9. Khan, M. U., Choudry, Z. A., Aziz, S., Naqvi, S. Z. H., Aymin, A., & Imtiaz, M. A. (2020). Biometric Authentication based on EMG Signals of Speech. 2nd International Conference on Electrical, Communication and Computer Engineering, ICECCE 2020, June, 2–6. https://doi.org/10.1109/ICECCE49384.2020.9179354
10. Kim, J. S., Kim, M. G., & Pan, S. B. (2021). Two-step biometrics using electromyogram signal based on convolutional neural network-long short-term memory networks. Applied Sciences (Switzerland), 11(15). https://doi.org/10.3390/app11156824
11. Kim, J. S., & Pan, S. B. (2017). A Study on EMG-based Biometrics. Journal of Internet Services and Information Security (JISIS), 7(2), 19–31. https://doi.org/http://dx.doi.org/10.22667/JISIS.2017.05.31.019
12. Li, Q., Dong, P., & Zheng, J. (2020). Enhancing the security of pattern unlock with surface emg-based biometrics. Applied Sciences (Switzerland), 10(2). https://doi.org/10.3390/app10020541
13. Lu, L., Mao, J., Wang, W., Ding, G., & Zhang, Z. (2020). A Study of Personal Recognition Method Based on EMG Signal. IEEE Transactions on Biomedical Circuits and Systems, 14(4), 681–691. https://doi.org/10.1109/TBCAS.2020.3005148
14. Mishra, V. K., Bajaj, V., Kumar, A., & Singh, G. K. (2016). Analysis of ALS and normal EMG signals based on empirical mode decomposition. IET Science, Measurement and Technology, 10(8), 963–971. https://doi.org/10.1049/iet-smt.2016.0208
15. Morikawa, S., Ito, S. I., Ito, M., & Fukumi, M. (2019). Personal authentication by lips EMG using dry electrode and CNN. 2018 IEEE International Conference on Internet of Things and Intelligence System, IOTAIS 2018, 180–183. https://doi.org/10.1109/IOTAIS.2018.8600859 Phinyomark, A., Limsakul, C., & Phukpattaranont, P. (2011). Application of wavelet analysis in EMG feature extraction for pattern classification. Measurement Science Review, 11(2), 45–52. https://doi.org/10.2478/v10048-011-0009-y Pradhan, A., He, J., & Jiang, N. (2022). Multi-day dataset of forearm and wrist electromyogram for hand gesture recognition and biometrics. Scientific Data, 9(1), 1–10. https://doi.org/10.1038/s41597-022-01836-y
16. Ramírez-Arias, F. J., García-Guerrero, E. E., Tlelo-Cuautle, E., Colores-Vargas, J. M., García-Canseco, E., López-Bonilla, O. R., Galindo-Aldana, G. M., & Inzunza-González, E. (2022). Evaluation of Machine Learning Algorithms for Classification of EEG Signals. Technologies, 10(4), 79. https://doi.org/10.3390/technologies10040079
17. Raurale, S. A., McAllister, J., & Rincon, J. M. Del. (2021). EMG Biometric Systems Based on Different Wrist-Hand Movements. IEEE Access, 9, 12256–12266. https://doi.org/10.1109/ACCESS.2021.3050704
18. Shin, S., Jung, J., & Kim, Y. T. (2017). A study of an EMG-based authentication algorithm using an artificial neural network. Proceedings of IEEE Sensors, 2017-Decem, 1–3. https://doi.org/10.1109/ICSENS.2017.8234158
19. Shin, S., Kang, M., Jung, J., & Kim, Y. T. (2021). Development of miniaturized wearable wristband type surface emg measurement system for biometric authentication. Electronics (Switzerland), 10(8). https://doi.org/10.3390/electronics10080923
20. Shioji, R., Ito, S. I., Ito, M., & Fukumi, M. (2018). Personal authentication and hand motion recognition based on wrist EMG analysis by a convolutional neural network. 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems, SCIS-ISIS 2018, 1172–1176. https://doi.org/10.1109/SCIS-ISIS.2018.00184
21. Shioji, R., Ito, S., Ito, M., & Fukumi, M. (2017). Personal Authentication Based on Wrist EMG Analysis by a Convolutional Neural Network. 5th IIAE International Conference on Intelligent Systems and Image Processing, 12–18. https://doi.org/10.12792/icisip2017.006
22. Taşar, B. (2022). Deep-BBiIdNet: Behavioral Biometric Identification Method Using Forearm Electromyography Signal. Arabian Journal for Science and Engineering. https://doi.org/10.1007/s13369-022-06909-z
23. Venugopalan, S., Juefei-Xu, F., Cowley, B., & Savvides, M. (2015). Electromyograph and keystroke dynamics for spoof-resistant biometric authentication. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2015-Octob, 109–118. https://doi.org/10.1109/CVPRW.2015.7301326