DETERMINING THE MOST POWERFUL FEATURES IN THE DESIGN OF AN AUTOMATIC SLEEP STAGING SYSTEM

Abstract

Spending too much time on manual sleep staging is tiring and challenging for sleep specialists. In addition, experience in sleep staging also creates different decisions for sleep experts. The search for finding an effective automatic sleep staging system has been accelerated in the last few years. There are many studies dealing with this problem but very few of them were conducted with real sleep data. Studies have been carried out on mostly processed and cleaned-ready data sets. In addition, there are few studies in which the data distribution in sleep stages is balanced (equal numbers of epochs from each stage are used), and it is seen that the performance of these studies is quite low compared to other studies. When the literature studies are examined, there is a wide range of studies in which many features are extracted, many feature selection methods are used, many classifiers are applied and various combinations of these are available. For this reason, to determine the best-performing features and the most powerful features, 168 features were extracted from the real EEG, EOG, and EMG signals of 124 patients. These features were selected with 7 different feature selection methods, and classification was carried out with 4 classifiers. In general, the ReliefF feature selection method has performed best, and the Bagged Tree classifier has reached the highest classification accuracy of 67.92% with the use of nonlinear features.

Keywords

• Automatic Sleep Staging
• Frequency Analysis of EEG Signals
• Sleep Signal Detection

Supporting Institution

TÜBİTAK

Project Number

119E127

Thanks

This study is supported by the Scientific and Technological Research Council of Turkey (TUBITAK) with project number: 119E127.

References

1. Aboalayon, K.A.I., Faezipour, M., Almuhammadi, W.S. & Moslehpour, S., (2016), Sleep Stage Classification Using EEG Signal Analysis: A Comprehensive Survey and New Investigation, Entropy, 18, 272; doi:10.3390/e18090272.
2. Acharya, U.R., Bhat, S., Faust, O., Adeli, H., Chua, E.C., Lim, W.J., & Koh, J.E. (2015). Nonlinear Dynamics Measures for Automated EEG-Based Sleep Stage Detection. European Neurology, 74, 268 - 287.
3. Arslan, R. S., Ulutaş, H., Köksal, A.S., Bakır, M., Çiftçi, B. (2022), “Automated sleep scoring system using multi-channel data and machine learning”, Computers in Biology and Medicine 146, 105653.
4. Azhagusundari, B., & Thanamani, A.S. (2013). Feature Selection based on Information Gain. International Journal of Innovative Technology and Exploring Engineering (IJITEE) ISSN: 2278-3075.
5. Balci, M., Tasdemir, S., Ozmen, G., Golcuk A., (2022), Machine Learning-Based Detection of Sleep-Disordered Breathing Type Using Time and Time-Frequency Features, Biomedical Signal Processing and Control, 73, 103402.
6. Barbi, M., Chillemi, S., Garbo, A. D., Balocchi, R., Carpeggiani, C., Emdin, M., Michelassi, C. & Santarcangelo, E., (1998), Predictability and nonlinearity of the heart rhythm, Chaos, Solitons & Fractals, 9 (3), 507-515.
7. Boostani, R., Karimzadeh, F., & Nami, M. (2017). A comparative review on sleep stage classification methods in patients and healthy individuals. Computer methods and programs in biomedicine, 140, 77-91.
8. Bose, R., Pratiher, S., & Chatterjee, S. (2019). Detection of epileptic seizure employing a novel set of features extracted from multifractal spectrum of electroencephalogram signals. IET Signal Process., 13, 157-164.

9. Breiman, L. (2004). Bagging predictors. Machine Learning, 24, 123-140.
10. Chaozhen, G., Siyang, L., Fulan, L. & Weichao, X., (2015), Sleep EEG staging based on Hilbert-Huang transform and sample entropy, 2015 International Conference on Computational Intelligence and Communication Networks
11. Chattopadhyay, G. & Chattopadhyay, S., (2014), Study on statistical aspects of monthly sunspot number time series and its long-range correlation through detrended fluctuation analysis, Indian Journal of Physics, 88 (11), 1135-1140.
12. Chi-Square. Available online: https://towardsdatascience.com/chi-square-test-for-feature-selection-in machine-learning-206b1f0b8223
13. Chlon, L., Song, A.H., Subramanian, S., Soulat, H., Tauber, C., Ba, D. & Prerau, M., Multitaper Spectral Estimation HDP-HMMs for EEG Sleep Inference, arXiv:1805.07300v1 [stat.ML] 18 May 2018, (last visited on 7 October 2021)
14. Di Matteo, T., Aste, T. & Dacorogna, M. M., (2003), Scaling behaviors in differently developed markets, Physica A: Statistical Mechanics and its Applications, 324 (1-2), 183-188.
15. Fix, E. & Hodges, J.L., (1951), An Important Contribution to Nonparametric Discriminant Analysis and Density Estimation, International Statistical Review / Revue Internationale de Statistique Vol. 57, No. 3 (Dec. 1989), pp. 233-238
16. Erdoğan, N. K., (2017), BİST100 Endeksinin Çokfraktallı Eğimden Arındırılmış Dalgalanma Analizi, Journal of Current Researches on Business and Economics, 7 (2), 555-564.
17. Farag, A.F., El-Metwally, S.M., & Morsy, A.A. (2014). A Sleep Scoring System Using EEG Combined Spectral and Detrended Fluctuation Analysis Features. Journal of Biomedical Science and Engineering, 07, 584-592.
18. Faust, O., Razaghi, H., Barika, R., Ciaccio, E. J., & Acharya, U. R. (2019). A review of automated sleep stage scoring based on physiological signals for the new millennia. Computer methods and programs in biomedicine, 176, 81–91. https://doi.org/10.1016/j.cmpb.2019.04.032
19. Fiorillo, L., Puiatti, A., Papandrea, M., Ratti, P. L., Favaro, P., Roth, C., Bargiotas, P., Bassetti, C. L., & Faraci, F. D. (2019). Automated sleep scoring: A review of the latest approaches. Sleep medicine reviews, 48, 101204. https://doi.org/10.1016/j.smrv.2019.07.007
20. Ghimatgar H., Kazemi K., Helfroush M. S., Aarabi A. (2019) “An automatic single-channel EEG-based sleep stage scoring method based on hidden Markov Model”, Journal of Neuroscience Methods, 324, 1082320
21. Göğüş, F. Z., 2020, Osas Hastaları için CPAP Cihazlarındaki Optimum Basıncın Yapay Zeka ile Tahmini, PhD thesis, Konya-Türkiye
22. Hassan, A. R., & Bhuiyan, M.I.H., (2016a). A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features. Journal of neuroscience methods, 271, 107–118. https://doi.org/10.1016/j.jneumeth.2016.07.012
23. Hassan, A.R., & Bhuiyan, M.I.H., (2016b), Automatic sleep scoring using statistical features in the EMD domain and ensemble methods, Biocybernetics and Biomedical Engineering 36, 248-255
24. Hassan, A.R., & Subasi, A. (2016). Automatic identification of epileptic seizures from EEG signals using linear programming boosting. Computer methods and programs in biomedicine, 136, 65-77.
25. Hassan, A.R., & Bhuiyan, M.I.H., (2017), An automated method for sleep staging from EEG signals using normal inverse Gaussian parameters and adaptive boosting, Neurocomputing219, 76–87
26. Huang, W., Guo, B., Shen, Y., Tang, X., Zhang, T., Li, D., & Jiang, Z. (2020). Sleep staging algorithm based on multichannel data adding and multifeature screening. Computer methods and programs in biomedicine, 187, 105253.
27. Iber, C., Ancoli-Israel, S., Chesson, A. L., Quan, S. L., (2007), The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, American Academy of Sleep Medicine, Westchester.
28. Japkowicz, N., Shah, M., (2014), Evaluating Learning Algorithms: A Classification Perspective, Cambridge University Press.
29. Jiang, D., LU, Y., Ma, Y. & Wang, Y., (2019), Robust sleep stage classification with single-channel EEG signals using multimodal decomposition and HMM-based refinement, Expert Systems With Applications 121, 188–203.
30. Kantelhardt, J. W., Zschiegner, S. A., Koscielny-Bunde, E., Havlin, S., Bunde, A. & Stanley, H. E., (2002), Multifractal detrended fluctuation analysis of nonstationary time series, Physica A: Statistical Mechanics and its Applications, 316, 87-114.
31. Khourdifi, Y., & Bahaj, M. (2018). Feature Selection with Fast Correlation-Based Filter for Breast Cancer Prediction and Classification Using Machine Learning Algorithms. 2018 International Symposium on Advanced Electrical and Communication Technologies (ISAECT), 1-6.
32. Korkailen, H., Leppanen, T., Duce, B., Kainulainen, S., et. al. (2021), “Detailed Assessment of Sleep Architecture With Deep Learning and Shorter Epoch-to-Epoch Duration Reveals Sleep Fragmentation of Patients With Obstructive Sleep Apnea”, IEEE Journals of Niomedical and Health Informatics, 25(7).
33. Lee, J. M., Kim, D. J., Kim, I. Y., Suk Park, K., & Kim, S. I. (2004). Nonlinear analysis of human sleep EEG using detrended fluctuation analysis. Medical Engineering & Physics, 26(9), 773–776. https://doi.org/10.1016/j.medengphy.2004.07.002
34. Li, C., & Xu, J. (2019). Feature selection with the Fisher score followed by the Maximal Clique Centrality algorithm can accurately identify the hub genes of hepatocellular carcinoma. Scientific reports, 9(1), 17283. https://doi.org/10.1038/s41598-019-53471-0
35. Liu, L., Wang, Q., Adeli, E., Zhang, L., Zhang, H., & Shen, D. (2016). Feature Selection Based on Iterative Canonical Correlation Analysis for Automatic Diagnosis of Parkinson's Disease. Medical image computing and computer-assisted intervention: MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention, 9901, 1–8. https://doi.org/10.1007/978-3-319-46723-8_1
36. Liu, Z., & Sun, J. (2015). Sleep Staging from the EEG Signal Using Multifractal Detrended Fluctuation Analysis. 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC), 63-68.
37. Liua, Z., Suna, J., Zhanga, Y. & Rolfea, P., (2016), Sleep staging from the EEG signal using multi-domain feature extraction, Biomedical Signal Processing and Control 30, 86–97
38. Márton, L. F., Brassai, S. T., Bakó, L. & Losonczi, L., (2014), Detrended Fluctuation Analysis of EEG Signals, Procedia Technology, 12, 125-132.
39. Myles, A.J., Feudale, R.N., Liu, Y., Woody, N., & Brown, S.D. (2004). An introduction to decision tree modeling. Journal of Chemometrics, 18.
40. Otis M. Solomon, Jr, PSD Computations Using Welch’s Method, SANDIA REPORT, S A N D 91-1533 • U C -7 0 6, Unlimited Release, Printed December 1991, USA
41. Peker, M. (2016). An efficient sleep scoring system based on EEG signal using complex-valued machine learning algorithms. Neurocomputing, 207, 165-177.
42. Peng, C., Havlin, S., Stanley, H.E., & Goldberger, A.L. (1995). Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series. Chaos, 5 1, 82-7.
43. Rückstieß, Thomas., Osendorfer, Christian., & van der Smagt, Patrick. (2011). Sequential Feature Selection for Classification. 10.1007/978-3-642-25832-9_14.
44. Tian, P., Hua, J., Qi, J., Ye, X., Che, D., Ding, Y. & Peng, Y., (2017), A hierarchical classification method for automatic sleep scoring using multiscale entropy features and proportion information of sleep architecture, Biocybernetics and Biomedical Engineering 37, 263-271
45. Urbanowicz, R.J., Meeker, M., Cava, W.L., Olson, R.S., & Moore, J. (2018). Relief-Based Feature Selection: Introduction and Review. Journal of biomedical informatics, 85, 189-203.
46. Vapnik, V. N., (2000), The Nature of Statistical Learning Theory., New York: Springer
47. Vaquerizo-Villar, F., Alvarez, D., Kheirandish-Goza, L., Gutiérrez-Tobal, G. C., Barroso-García, V., Crespo, A., Campo, F. d., Gozal, D. & Hornero, R., (2018), Detrended fluctuation analysis of the oximetry signal to assist in pediatric sleep apnoea-hypopnoea syndrome diagnosis, Physiological Measurement, 39 (11).
48. Zero Crossing Rate[online], https://www.sciencedirect.com/topics/engineering/zero-crossing-rate
49. Zhang, Y., Wang, B., Jing, J., Zhang, J., Zou, J., & Nakamura, M. (2017). A Comparison Study on Multidomain EEG Features for Sleep Stage Classification. Computational Intelligence and Neuroscience, 2017.
50. Zhang, Z. & Guan, C., (2017), An Accurate Sleep Staging System with Novel Feature Generation and Auto-Mapping, IEEE International Conference on Orange Technologies (ICOT)