Utilizing Mel-Frequency Cepstral Coefficients for Acoustic Diagnostics of Damaged UAV Propellers

Abstract

In this study, the diagnostic potential of the acoustic signatures of Unmanned Aerial Vehicle (UAVs) propellers which is one of the critical components of these vehicles were examined under different damage conditions. For this purpose, a test bench was set up and acoustic data of five different damaged propellers and one undamaged propeller were collected. The methodology emphasized contains using an omnidirectional microphone to collect data under three different thrust levels which correspond to 25%, 50% and 75%. Propeller acoustics sound characteristics extracted using the Mel Frequency Cepstrum Coefficient (MFCC) technique that incorporates Fast Fourier Transform (FFT) in order to obtain feature extracted data, and the visual differences of sound patterns were discussed to underline its importance in terms of diagnostics. The results indicated that there is a potential for classifying slightly and symmetrically damaged and undamaged propellers successfully in an Artificial Intelligence-based diagnostic application using MFCC. This study aimed to demonstrate a way to effectively use MFCC detecting damaged and undamaged propellers through their sound profiles and highlighted its usage potential for future integration into Artificial Intelligence (AI) methods in terms of UAV diagnostics. The findings provided a foundation for creating an advanced diagnostic method for increasing UAV safety and operational efficiency.

Keywords

• Mel-Frequency Cepstral Coefficients
• UAV
• MFCC
• Diagnostics
• Acoustics
• Propellers

References

1. Abdul, Z.K. and Al-Talabani, A.K., 2022. Mel frequency cepstral coefficient and its applications: A review. IEEE Access, 10, pp.122136-122158.
2. Adamo, F., Andria, G., Di Nisio, A., Carducci, C.G.C., Lanzolla, A.M. and Mattencini, G., 2017, June. Development and characterization of a measurement instrumentation system for UAV components testing. In 2017 IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace) (pp. 355-359). IEEE.
3. Adão, T., Hruška, J., Pádua, L., Bessa, J., Peres, E., Morais, R. and Sousa, J.J., 2017. Hyperspectral imaging: A review on UAV-based sensors, data processing and applications for agriculture and forestry. Remote sensing, 9(11), p.1110.
4. Alharasees, O., Adali, O.H. and Kale, U., 2023, June. Human Factors in the Age of Autonomous UAVs: Impact of Artificial Intelligence on Operator Performance and Safety. In 2023 International Conference on Unmanned Aircraft Systems (ICUAS) (pp. 798-805). IEEE.
5. Alharasees, O., Adali, O.H. and Kale, U., 2023, November. UAV Operators’ Cognition and Automation: Comprehensive Measurements. In 2023 New Trends in Aviation Development (NTAD) (pp. 15-20). IEEE.
6. Alharasees, O., Abdalla, M.S. and Kale, U., 2022, November. Analysis of human factors analysis and classification system (HFACS) of UAV operators. In 2022 New Trends in Aviation Development (NTAD) (pp. 10-14). IEEE.
7. Baiocchi, V., Dominici, D. and Mormile, M., 2013. UAV application in post–seismic environment. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 40, pp.21-25.
8. Berghout, T. and Benbouzid, M., 2024, May. Acoustic Emission-based Fault Diagnosis for Drones with Heterogeneous Multiverse Recurrent Expansion: Avoiding Representation Glitch. In 2024 International Conference on Control, Automation and Diagnosis (ICCAD) (pp. 1-6). IEEE.

9. Chen, S., Meng, W., Xu, W., Liu, Z., Liu, J. and Wu, F., 2020, November. A warehouse management system with uav based on digital twin and 5g technologies. In 2020 7th International Conference on information, cybernetics, and computational social systems (ICCSS) (pp. 864-869). IEEE.
10. Dumitrescu, C., Minea, M., Costea, I.M., Cosmin Chiva, I. and Semenescu, A., 2020. Development of an acoustic system for UAV detection. Sensors, 20(17), p.4870.
11. Ekici, S., Dalkiran, A., Karakoc, T.H. (2023). A Short Review on New Development Achievements and Market Opportunities in Unmanned Systems. In: Karakoc, T.H., Yilmaz, N., Dalkiran, A., Ercan, A.H. (eds) New Achievements in Unmanned Systems. ISUDEF 2021. Sustainable Aviation. Springer, Cham. https://doi.org/10.1007/978-3-031-29933-9_1
12. FAA (2013), “Operational Use of Flight Path Management Systems”, Available at: https://www.faa.gov/sites/faa.gov/files/aircraft/air_cert/design_approvals/human_factors/OUFPMS_Report.pdf
13. Fan, B., Li, Y., Zhang, R. and Fu, Q., 2020. Review on the technological development and application of UAV systems. Chinese Journal of Electronics, 29(2), pp.199-207.
14. Frid, A., Ben-Shimol, Y., Manor, E. and Greenberg, S., 2024. Drones Detection Using a Fusion of RF and Acoustic Features and Deep Neural Networks. Sensors, 24(8), p.2427.
15. Gago, R.M., Pereira, M.Y. and Pereira, G.A., 2021. An aerial robotic system for inventory of stockpile warehouses. Engineering Reports, 3(9), p.e12396.
16. Jamil, S., Fawad, Rahman, M., Ullah, A., Badnava, S., Forsat, M. and Mirjavadi, S.S., 2020. Malicious UAV detection using integrated audio and visual features for public safety applications. Sensors, 20(14), p.3923.
17. Jiao, Q., Wang, X., Wang, L. and Bai, H., 2023. Audio features based ADS-CNN method for flight attitude recognition of quadrotor UAV. Applied Acoustics, 211, p.109540.
18. Jiqing, L., Husheng, F., Qin, Y. and Chunhua, Z., 2021, June. Quad-rotor UAV Audio Recognition Based on Mel Spectrum with Binaural Representation and CNN. In 2021 International Conference on Computer Engineering and Application (ICCEA) (pp. 285-290). IEEE.
19. Katta, S.S., Vuojärvi, K., Nandyala, S., Kovalainen, U.M. and Baddeley, L., 2022, May. Real-world on-board uav audio data set for propeller anomalies. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 146-150). IEEE.
20. Kołodziejczak, M., Puchalski, R., Bondyra, A., Sladic, S. and Giernacki, W., 2023, June. Toward lightweight acoustic fault detection and identification of UAV rotors. In 2023 International Conference on Unmanned Aircraft Systems (ICUAS) (pp. 990-997). IEEE.
21. Kucukkor, O., Aras, O., Ozbek, E., Ekici, S. and Karakoc, T.H., 2023. Design and analysis of an IoT enabled unmanned aerial vehicle to monitor carbon monoxide: methodology and application. International Journal of Global Warming, 29(1-2), pp.66-77.
22. Liang, B., Iwnicki, S.D. and Zhao, Y., 2013. Application of power spectrum, cepstrum, higher order spectrum and neural network analyses for induction motor fault diagnosis. Mechanical Systems and Signal Processing, 39(1-2), pp.342-360.
23. Lyu, M., Zhao, Y., Huang, C. and Huang, H., 2023. Unmanned aerial vehicles for search and rescue: A survey. Remote Sensing, 15(13), p.3266.
24. Mohsan, S.A.H., Khan, M.A., Noor, F., Ullah, I. and Alsharif, M.H., 2022. Towards the unmanned aerial vehicles (UAVs): A comprehensive review. Drones, 6(6), p.147.
25. Pourpanah, F., Zhang, B., Ma, R. and Hao, Q., 2018, October. Anomaly detection and condition monitoring of UAV motors and propellers. In 2018 IEEE SENSORS (pp. 1-4). IEEE.
26. Salman, S., Mir, J., Farooq, M.T., Malik, A.N. and Haleemdeen, R., 2021, January. Machine learning inspired efficient audio drone detection using acoustic features. In 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST) (pp. 335-339). IEEE.
27. Shen, F.Y., Li, W., Jiang, D.N. and Mao, H.J., 2024. Autonomous predictive maintenance of quadrotor UAV with multi-actuator degradation. The Aeronautical Journal, pp.1-25.
28. Suman, A., Kumar, C. and Suman, P., 2022. Early detection of mechanical malfunctions in vehicles using sound signal processing. Applied Acoustics, 188, p.108578.
29. Tong, B., Wang, J., Wang, X., Zhou, F., Mao, X. and Zheng, W., 2022. Optimal route planning for truck–drone delivery using variable neighborhood tabu search algorithm. Applied sciences, 12(1), p.529.
30. Wang, X., Yadav, V. and Balakrishnan, S.N., 2007. Cooperative UAV formation flying with obstacle/collision avoidance. IEEE Transactions on control systems technology, 15(4), pp.672-679.
31. Utebayeva, D., Almagambetov, A., Alduraibi, M., Temirgaliyev, Y., Ilipbayeva, L. and Marxuly, S., 2020, November. Multi-label UAV sound classification using Stacked Bidirectional LSTM. In 2020 Fourth IEEE International Conference on Robotic Computing (IRC) (pp. 453-458). IEEE.
32. Van Der Maaten, L., Postma, E.O. and van den Herik, H.J., 2009. Dimensionality reduction: A comparative review. Journal of Machine Learning Research, 10(66-71), p.13.
33. Yaman, O., Yol, F. and Altinors, A., 2022. A fault detection method based on embedded feature extraction and SVM classification for UAV motors. Microprocessors and Microsystems, 94, p.104683.
34. Zhang, B., Song, Z., Zhao, F. and Liu, C., 2022. Overview of propulsion systems for unmanned aerial vehicles. Energies, 15(2), p.455.
35. Zhang, X. and Zhao, X., 2020. Architecture design of distributed redundant flight control computer based on time-triggered buses for UAVs. IEEE Sensors Journal, 21(3), pp.3944-3954.