Research Article
BibTex RIS Cite

Makine öğrenmesi algoritmaları kullanılarak elektromiyografi tabanlı el hareketi sınıflandırması ve özellik çıkarımı

Year 2023, Volume: 26 Issue: 4, 1621 - 1633, 01.12.2023
https://doi.org/10.2339/politeknik.1348121

Abstract

El hareketlerinin sınıflandırılması özellikle ortez ve protez kontrolü, insan-makine etkileşimi ve telerehabilitasyon uygulamaları için önem arz etmektedir. Görüntü işleme tekniklerine dayalı hareket analizi yöntemleri ile el hareketlerinin belirlenmesi uzun yıllardır uygulanmaktadır. Günümüzde üzerinde durulan araştırma alanlarından biri kas kasılmasından faydalanarak el hareketlerinin belirlenmesidir. Son yıllarda el ve kol kaslarından alınan sEMG (yüzey elektromiyografi) verileri yardımıyla el hareketlerinin sınıflandırılması üzerine çalışmalar hız kazanmıştır. Bizim çalışmamızda 4 gönüllü katılımcı üzerinden toplanan Ekstansör digitorum ve Fleksör carpi radialis kaslarının EMG verileri kullanılarak elin açık (parmakların ekstansiyonu) ve kapalı (parmakların fleksiyonu) konumları tahmin edilmiştir. EMG sinyallerini doğru bir şekilde ayırt etmek için varyans, standart sapma, kök ortalama kare, ortalama enerji, minimum ve maksimum özellikler gibi çeşitli istatistiksel ölçütler kullanılmıştır. Bu ilave özelliklerle birlikte elde edilen veri seti Destek Vektör Makinesi (SVM), K-En Yakın Komşu (KNN), Karar Ağacı (DT) ve Gaussian Naive Bayes (GNB) algoritmalarına uygulanmış ve elin açık-kapalı konumları sınıflandırılmıştır. Sınıflandırma başarısı en yüksek algoritmanın SVM (max. 73.1%), en düşük algoritmanın ise KNN (min. 55.9%) olduğu görülmüştür. Gelecekteki çalışmalarda tahmin doğruluğunu daha da artırmak için daha fazla kas grubundan veri toplanması önerilmektedir.

References

  • [1] Kang S., Kim H., Park C., Sim Y., Lee S. and Jung Y., “sEMG-Based Hand Gesture Recognition Using Binarized Neural Network”, Sensors, 23(3): 1436, (2023).
  • [2] Jarosz J., Gołaś A., Krzysztofik M., Matykiewicz P., Strońska K., Zając A. and Maszczyk A., “Changes in muscle pattern activity during the asymmetric flat bench press (offset training)”, International Journal of Environmental Research and Public Health, 17(11): 3912, (2020).
  • [3] Borysiuk Z., Blaszczyszyn M., Piechota K., Konieczny M. and Cynarski W.J., “Correlations between the EMG Structure of Movement Patterns and Activity of Postural Muscles in Able-Bodied and Wheelchair Fencers”, Sensors, 23(1): 135, (2022).
  • [4] Xie Z., “Fatigue Monitoring and Recognition During Basketball Sports via Physiological Signal Analysis”, International Journal of Information System Modeling and Design, 13(2): 1-11, (2022).
  • [5] Phillips D.A., Del Vecchio A.R., Carroll K. and Matthews E.L., “Developing a Practical Application of the Isometric Squat and Surface Electromyography”, Biomechanics, 1(1): 145-151, (2021).
  • [6] Jochumsen M., Niazi I.K., Zia ur Rehman M., Amjad I., Shafique M., Gilani S.O., and Waris A., “Decoding attempted hand movements in stroke patients using surface electromyography”, Sensors, 20(23): 6763, (2020).
  • [7] Fu Y.L., Liang K.C., Song W. and Huang J., “A hybrid approach to product prototype usability testing based on surface EMG images and convolutional neural network classification”, Computer Methods and Programs in Biomedicine, 221: 106870, (2022).
  • [8] Karnam N.K., Dubey S.R., Turlapaty A.C., and Gokaraju B., “EMGHandNet: A hybrid CNN and Bi-LSTM architecture for hand activity classification using surface EMG signals”, Biocybernetics and biomedical engineering, 42(1): 325-340, (2022).
  • [9] Sahu P., Singh B. K. and Nirala N., “An improved feature selection approach using global best guided Gaussian artificial bee colony for EMG classification”, Biomedical Signal Processing and Control, 80: 104399, (2023).
  • [10] Fajardo J.M., Gomez O. and Prieto F., “EMG hand gesture classification using handcrafted and deep features”, Biomedical Signal Processing and Control, 63: 102210, (2021).
  • [11] Tepe C. and Demir M.C., “Real-Time Classification of EMG Myo Armband Data Using Support Vector Machine” IRBM, 43(4): 300-308, (2022).
  • [12] Klein Breteler M.D., Simura K.J. and Flanders M., “Timing of muscle activation in a hand movement sequence”, Cerebral Cortex, 17(4): 803-815, (2007).
  • [13] Khushaba R.N, Kodagoda S., Takruri M. and Dissanayake G., “Toward improved control of prosthetic using surface electromyogram (EMG) signals” Expert Systems with Applications 39:10731-10738, (2012).
  • [14] Roldan-Vasco S., Orozco-Duque A. and Orozco-Arroyave J.R., “Swallowing disorders analysis using surface EMG biomarkers and classification models”, Digital Signal Processing, 133: 103815, (2023).
  • [15] Torres-Castillo J.R., Lopez-Lopez C.O. and Padilla-Castaneda M.A., “Neuromuscular disorders detection through time-frequency analysis and classification of multi-muscular EMG signals using Hilbert-Huang transform”, Biomedical Signal Processing and Control, 71: 103037, (2022).
  • [16] Putra D.S. and Weru Y.U.W., “Pattern recognition of electromyography (EMG) signal for wrist movement using learning vector quantization (LVQ)”, In IOP Conference Series: Materials Science and Engineering, 50681):, p. 012020, (2019).
  • [17] López L.I.B., Caraguay Á.L.V., Vimos V.H., Zea J.A., Vásconez J.P., Álvarez M. and Benalcázar M.E., “An energy-based method for orientation correction of EMG bracelet sensors in hand gesture recognition systems”, Sensors, 20(21): 6327, (2020).
  • [18] Kısa D.H., Özdemir M.A., Güren O. and Alaybeyoğlu, A., “A decision-making mechanism based on EMG signals and adaptive neural fuzzy inference system (ANFIS) for hand gesture prediction”, Journal of the Faculty of Engineering and Architecture of Gazi University, 38(3): 1417-1430, (2023).
  • [19] Vapnik V.N., “The nature of statistical learning theory”, Springer science & business media, (2000).
  • [20] Yiğit H., Köylü H. and Eken, S., “Estimation of road surface type from brake pressure pulses of ABS”, Expert Systems with Applications, 212: 118726, (2023).
  • [21] Ay Ş., Ekinci E. and Garip Z., “A comparative analysis of meta-heuristic optimization algorithms for feature selection on ML-based classification of heart-related diseases”, The Journal of Supercomputing, 1-30, (2023).
  • [22] Şengür D., “EEG, EMG and ECG based determination of psychosocial risk levels in teachers based on wavelet extreme learning machine autoencoders”, Politeknik Dergisi, 25(3): 985-989, (2022).
  • [23] Cica D., Sredanovic B., Tesic S. and Kramar, D., “Predictive modeling of turning operations under different cooling/lubricating conditions for sustainable manufacturing with machine learning techniques”, Applied Computing and Informatics, 1-19, (2020).
  • [24] Atban F., Ekinci E. and Garip Z., “Traditional machine learning algorithms for breast cancer image classification with optimized deep features”, Biomedical Signal Processing and Control, 81: 104534, (2023).
  • [25] Han J., “System optimization of talent Life cycle management platform based on decision tree model”, Journal of Mathematics, 2022: 1-12, (2022).
  • [26] Latash M.L., “Muscle coactivation: definitions, mechanisms, and functions”, Journal of neurophysiology, 120(1): 88-104, (2018).

Electromyography based hand movement classification and feature extraction using machine learning algorithms

Year 2023, Volume: 26 Issue: 4, 1621 - 1633, 01.12.2023
https://doi.org/10.2339/politeknik.1348121

Abstract

The categorization of hand gestures holds significant importance in controlling orthotic and prosthetic devices, enabling human-machine interaction, and facilitating telerehabilitation applications. For many years, methods of motion analysis based on image processing techniques have been employed to detect hand motions. However, recent research has focused on utilizing muscle contraction for detecting hand movements. Specifically, there has been an increase in studies that classify hand movements using surface electromyography (sEMG) data from the muscles of the hand and arm. In our study, we estimated the open (extension of the fingers) and closed (flexion of the fingers) positions of the hand by analyzing EMG data obtained from 4 volunteer participants' Extensor digitorum and Flexor carpi radialis muscles. In order to accurately discriminate EMG signals, various statistical measures such as variance, standard deviation, root mean square, average energy, minimum and maximum features were utilized. The dataset containing these additional features was then subjected to classification algorithms including Support Vector Machines (SVM), K Nearest Neighbour (KNN), Decision Tree (DT), and Gaussian Naive Bayes (GNB) for the purpose of classifying hand positions into open or closed states. Among the tested algorithms, SVM achieved the highest success rate with a maximum accuracy of 73.1%, while KNN yielded the lowest success rate at a minimum accuracy of 55.9%. To further enhance prediction accuracy in future studies, it is suggested that data from a larger set of muscles be collected.

References

  • [1] Kang S., Kim H., Park C., Sim Y., Lee S. and Jung Y., “sEMG-Based Hand Gesture Recognition Using Binarized Neural Network”, Sensors, 23(3): 1436, (2023).
  • [2] Jarosz J., Gołaś A., Krzysztofik M., Matykiewicz P., Strońska K., Zając A. and Maszczyk A., “Changes in muscle pattern activity during the asymmetric flat bench press (offset training)”, International Journal of Environmental Research and Public Health, 17(11): 3912, (2020).
  • [3] Borysiuk Z., Blaszczyszyn M., Piechota K., Konieczny M. and Cynarski W.J., “Correlations between the EMG Structure of Movement Patterns and Activity of Postural Muscles in Able-Bodied and Wheelchair Fencers”, Sensors, 23(1): 135, (2022).
  • [4] Xie Z., “Fatigue Monitoring and Recognition During Basketball Sports via Physiological Signal Analysis”, International Journal of Information System Modeling and Design, 13(2): 1-11, (2022).
  • [5] Phillips D.A., Del Vecchio A.R., Carroll K. and Matthews E.L., “Developing a Practical Application of the Isometric Squat and Surface Electromyography”, Biomechanics, 1(1): 145-151, (2021).
  • [6] Jochumsen M., Niazi I.K., Zia ur Rehman M., Amjad I., Shafique M., Gilani S.O., and Waris A., “Decoding attempted hand movements in stroke patients using surface electromyography”, Sensors, 20(23): 6763, (2020).
  • [7] Fu Y.L., Liang K.C., Song W. and Huang J., “A hybrid approach to product prototype usability testing based on surface EMG images and convolutional neural network classification”, Computer Methods and Programs in Biomedicine, 221: 106870, (2022).
  • [8] Karnam N.K., Dubey S.R., Turlapaty A.C., and Gokaraju B., “EMGHandNet: A hybrid CNN and Bi-LSTM architecture for hand activity classification using surface EMG signals”, Biocybernetics and biomedical engineering, 42(1): 325-340, (2022).
  • [9] Sahu P., Singh B. K. and Nirala N., “An improved feature selection approach using global best guided Gaussian artificial bee colony for EMG classification”, Biomedical Signal Processing and Control, 80: 104399, (2023).
  • [10] Fajardo J.M., Gomez O. and Prieto F., “EMG hand gesture classification using handcrafted and deep features”, Biomedical Signal Processing and Control, 63: 102210, (2021).
  • [11] Tepe C. and Demir M.C., “Real-Time Classification of EMG Myo Armband Data Using Support Vector Machine” IRBM, 43(4): 300-308, (2022).
  • [12] Klein Breteler M.D., Simura K.J. and Flanders M., “Timing of muscle activation in a hand movement sequence”, Cerebral Cortex, 17(4): 803-815, (2007).
  • [13] Khushaba R.N, Kodagoda S., Takruri M. and Dissanayake G., “Toward improved control of prosthetic using surface electromyogram (EMG) signals” Expert Systems with Applications 39:10731-10738, (2012).
  • [14] Roldan-Vasco S., Orozco-Duque A. and Orozco-Arroyave J.R., “Swallowing disorders analysis using surface EMG biomarkers and classification models”, Digital Signal Processing, 133: 103815, (2023).
  • [15] Torres-Castillo J.R., Lopez-Lopez C.O. and Padilla-Castaneda M.A., “Neuromuscular disorders detection through time-frequency analysis and classification of multi-muscular EMG signals using Hilbert-Huang transform”, Biomedical Signal Processing and Control, 71: 103037, (2022).
  • [16] Putra D.S. and Weru Y.U.W., “Pattern recognition of electromyography (EMG) signal for wrist movement using learning vector quantization (LVQ)”, In IOP Conference Series: Materials Science and Engineering, 50681):, p. 012020, (2019).
  • [17] López L.I.B., Caraguay Á.L.V., Vimos V.H., Zea J.A., Vásconez J.P., Álvarez M. and Benalcázar M.E., “An energy-based method for orientation correction of EMG bracelet sensors in hand gesture recognition systems”, Sensors, 20(21): 6327, (2020).
  • [18] Kısa D.H., Özdemir M.A., Güren O. and Alaybeyoğlu, A., “A decision-making mechanism based on EMG signals and adaptive neural fuzzy inference system (ANFIS) for hand gesture prediction”, Journal of the Faculty of Engineering and Architecture of Gazi University, 38(3): 1417-1430, (2023).
  • [19] Vapnik V.N., “The nature of statistical learning theory”, Springer science & business media, (2000).
  • [20] Yiğit H., Köylü H. and Eken, S., “Estimation of road surface type from brake pressure pulses of ABS”, Expert Systems with Applications, 212: 118726, (2023).
  • [21] Ay Ş., Ekinci E. and Garip Z., “A comparative analysis of meta-heuristic optimization algorithms for feature selection on ML-based classification of heart-related diseases”, The Journal of Supercomputing, 1-30, (2023).
  • [22] Şengür D., “EEG, EMG and ECG based determination of psychosocial risk levels in teachers based on wavelet extreme learning machine autoencoders”, Politeknik Dergisi, 25(3): 985-989, (2022).
  • [23] Cica D., Sredanovic B., Tesic S. and Kramar, D., “Predictive modeling of turning operations under different cooling/lubricating conditions for sustainable manufacturing with machine learning techniques”, Applied Computing and Informatics, 1-19, (2020).
  • [24] Atban F., Ekinci E. and Garip Z., “Traditional machine learning algorithms for breast cancer image classification with optimized deep features”, Biomedical Signal Processing and Control, 81: 104534, (2023).
  • [25] Han J., “System optimization of talent Life cycle management platform based on decision tree model”, Journal of Mathematics, 2022: 1-12, (2022).
  • [26] Latash M.L., “Muscle coactivation: definitions, mechanisms, and functions”, Journal of neurophysiology, 120(1): 88-104, (2018).
There are 26 citations in total.

Details

Primary Language English
Subjects Machine Learning (Other), Biomechanical Engineering
Journal Section Research Article
Authors

Ekin Ekinci 0000-0003-0658-592X

Zeynep Garip 0000-0002-0420-8541

Kasım Serbest 0000-0002-0064-4020

Early Pub Date November 13, 2023
Publication Date December 1, 2023
Submission Date August 22, 2023
Published in Issue Year 2023 Volume: 26 Issue: 4

Cite

APA Ekinci, E., Garip, Z., & Serbest, K. (2023). Electromyography based hand movement classification and feature extraction using machine learning algorithms. Politeknik Dergisi, 26(4), 1621-1633. https://doi.org/10.2339/politeknik.1348121
AMA Ekinci E, Garip Z, Serbest K. Electromyography based hand movement classification and feature extraction using machine learning algorithms. Politeknik Dergisi. December 2023;26(4):1621-1633. doi:10.2339/politeknik.1348121
Chicago Ekinci, Ekin, Zeynep Garip, and Kasım Serbest. “Electromyography Based Hand Movement Classification and Feature Extraction Using Machine Learning Algorithms”. Politeknik Dergisi 26, no. 4 (December 2023): 1621-33. https://doi.org/10.2339/politeknik.1348121.
EndNote Ekinci E, Garip Z, Serbest K (December 1, 2023) Electromyography based hand movement classification and feature extraction using machine learning algorithms. Politeknik Dergisi 26 4 1621–1633.
IEEE E. Ekinci, Z. Garip, and K. Serbest, “Electromyography based hand movement classification and feature extraction using machine learning algorithms”, Politeknik Dergisi, vol. 26, no. 4, pp. 1621–1633, 2023, doi: 10.2339/politeknik.1348121.
ISNAD Ekinci, Ekin et al. “Electromyography Based Hand Movement Classification and Feature Extraction Using Machine Learning Algorithms”. Politeknik Dergisi 26/4 (December 2023), 1621-1633. https://doi.org/10.2339/politeknik.1348121.
JAMA Ekinci E, Garip Z, Serbest K. Electromyography based hand movement classification and feature extraction using machine learning algorithms. Politeknik Dergisi. 2023;26:1621–1633.
MLA Ekinci, Ekin et al. “Electromyography Based Hand Movement Classification and Feature Extraction Using Machine Learning Algorithms”. Politeknik Dergisi, vol. 26, no. 4, 2023, pp. 1621-33, doi:10.2339/politeknik.1348121.
Vancouver Ekinci E, Garip Z, Serbest K. Electromyography based hand movement classification and feature extraction using machine learning algorithms. Politeknik Dergisi. 2023;26(4):1621-33.