Automatic Diagnosis of Snoring Sounds with the Developed Artificial Intelligence-based Hybrid Model

Abstract

Sleep patterns and sleep continuity have a great impact on people's quality of life. The sound of snoring both reduces the sleep quality of the snorer and disturbs other people in the environment. Interpretation of sleep signals by experts and diagnosis of the disease is a difficult and costly process. Therefore, in the study, an artificial intelligence-based hybrid model was developed for the classification of snoring sounds. In the proposed method, first of all, sound signals were converted into images using the Mel-spectrogram method. The feature maps of the obtained images were obtained using Alexnet and Resnet101 architectures. After combining the feature maps that are different in each architecture, dimension reduction was made using the NCA dimension reduction method. The feature map optimized using the NCA method was classified in the Bilayered Neural Network. In addition, spectrogram images were classified with 8 different CNN models to compare the performance of the proposed model. Later, in order to test the performance of the proposed model, feature maps were obtained using the MFCC method and the obtained feature maps were classified in different classifiers. The accuracy value obtained in the proposed model is 99.5%.

Keywords

• Deep Learning
• Classifiers
• CNN
• MFCC
• Snoring
• Spectrogram

References

1. [1] Veiga, A., et al. An IoT-based smart pillow for sleep quality monitoring in AAL environments. in 2018 Third International Conference on Fog and Mobile Edge Computing (FMEC). 2018. IEEE.
2. [2] Oksenberg, A. and D.S. Silverberg, The effect of body posture on sleep-related breathing disorders: facts and therapeutic implications. Sleep medicine reviews, 1998. 2(3): p. 139-162.
3. [3] Kwekkeboom, K.L., et al., The role of inflammation in the pain, fatigue, and sleep disturbance symptom cluster in advanced cancer. Journal of pain and symptom management, 2018. 55(5): p. 1286-1295.
4. [4] https://www.everydayhealth.com/news/eleven-health-risks-snoring/.
5. [5] Jodaki, K., et al., Effect of rosa damascene aromatherapy on anxiety and sleep quality in cardiac patients: A randomized controlled trial. Complementary Therapies in Clinical Practice, 2021. 42: p. 101299.
6. [6] Tietjens, J.R., et al., Obstructive sleep apnea in cardiovascular disease: a review of the literature and proposed multidisciplinary clinical management strategy. Journal of the American Heart Association, 2019. 8(1): p. e010440.
7. [7] Khan, T., A deep learning model for snoring detection and vibration notification using a smart wearable gadget. Electronics, 2019. 8(9): p. 987.
8. [8] Jiang, Y., J. Peng, and X. Zhang, Automatic snoring sounds detection from sleep sounds based on deep learning. Physical and engineering sciences in medicine, 2020. 43(2): p. 679-689.

9. [9] Cavusoglu, M., et al., An efficient method for snore/nonsnore classification of sleep sounds. Physiological measurement, 2007. 28(8): p. 841.
10. [10] Dafna, E., A. Tarasiuk, and Y. Zigel, Automatic detection of whole night snoring events using non-contact microphone. PloS one, 2013. 8(12): p. e84139.
11. [11] Wang, C., et al., Automatic snoring sounds detection from sleep sounds via multi-features analysis. Australasian physical & engineering sciences in medicine, 2017. 40(1): p. 127-135.
12. [12] Lim, S.J., et al., Classification of snoring sound based on a recurrent neural network. Expert Systems with Applications, 2019. 123: p. 237-245.
13. [13] Arsenali, B., et al. Recurrent neural network for classification of snoring and non-snoring sound events. in 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 2018. IEEE.
14. [14] Shen, F., et al., Detection of Snore from OSAHS Patients Based on Deep Learning. Journal of Healthcare Engineering, 2020. 2020.
15. [15] Skoczylas, A., et al., Belt conveyors rollers diagnostics based on acoustic signal collected using autonomous legged inspection robot. Applied Sciences, 2021. 11(5): p. 2299.
16. [16] Bhatti, F.A., et al., Shared spectrum monitoring using deep learning. IEEE Transactions on Cognitive Communications and Networking, 2021. 7(4): p. 1171-1185.
17. [17] Krizhevsky, A., I. Sutskever, and G.E. Hinton, Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 2012. 25.
18. [18] Redmon, J. and A. Farhadi, Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767, 2018.
19. [19] He, K., et al. Deep residual learning for image recognition. in Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
20. [20] Huang, G., et al. Densely connected convolutional networks. in Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.
21. [21] Szegedy, C., et al. Going deeper with convolutions. in Proceedings of the IEEE conference on computer vision and pattern recognition. 2015.
22. [22] Howard, A.G., et al., Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861, 2017.
23. [23] Szegedy, C., et al. Rethinking the inception architecture for computer vision. in Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
24. [24] Tan, M. and Q. Le. Efficientnet: Rethinking model scaling for convolutional neural networks. in International conference on machine learning. 2019. PMLR.
25. [25] Eroğlu, O. and M. Yildirim, Automatic detection of eardrum otoendoscopic images in patients with otitis media using hybrid‐based deep models. International Journal of Imaging Systems and Technology, 2022. 32(3): p. 717-727.
26. [26] He, X., et al. Neighborhood preserving embedding. in Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1. 2005. IEEE.
27. [27] Davis, S. and P. Mermelstein, Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE transactions on acoustics, speech, and signal processing, 1980. 28(4): p. 357-366.
28. [28] Deng, M., et al., Heart sound classification based on improved MFCC features and convolutional recurrent neural networks. Neural Networks, 2020. 130: p. 22-32.
29. [29] Karan, B., S.S. Sahu, and K. Mahto, Parkinson disease prediction using intrinsic mode function based features from speech signal. Biocybernetics and Biomedical Engineering, 2020. 40(1): p. 249-264.
30. [30] Rish, I. An empirical study of the naive Bayes classifier. in IJCAI 2001 workshop on empirical methods in artificial intelligence. 2001.
31. [31] Joachims, T., 11 Making Large-Scale Support Vector Machine Learning Practical. Advances in kernel methods: support vector learning, 1999: p. 169.
32. [32] Kleinbaum, D.G., et al., Logistic regression. 2002: Springer.
33. [33] Keller, J.M., M.R. Gray, and J.A. Givens, A fuzzy k-nearest neighbor algorithm. IEEE transactions on systems, man, and cybernetics, 1985(4): p. 580-585.
34. [34] Friedman, J.H., Greedy function approximation: a gradient boosting machine. Annals of statistics, 2001: p. 1189-1232.
35. [35] Liaw, A. and M. Wiener, Classification and regression by randomForest. R news, 2002. 2(3): p. 18-22.
36. [36] Eroglu, Y., et al., Diagnosis and grading of vesicoureteral reflux on voiding cystourethrography images in children using a deep hybrid model. Computer Methods and Programs in Biomedicine, 2021. 210: p. 106369.
37. [37] Brockmann, P.E., et al., Reduced sleep spindle activity in children with primary snoring. Sleep Medicine, 2020. 65: p. 142-146.
38. [38] Macarthur, K.E., et al., Dissociation between objectively quantified snoring and sleep quality. American Journal of Otolaryngology, 2020. 41(1): p. 102283.