Enhancing Radar Image Classification with Autoencoder-CNN Hybrid System

Abstract

The tracking, analysis, and classification of human movements can be crucial, particularly in areas such as elderly care, healthcare, and infant care. Typically, such tracking is done remotely with cameras. However, radar systems have emerged as significant methods and tools for these tasks due to their advantages such as privacy, wireless operation, and the ability to work through walls. By converting reflected radar signals from targets into images, human activities can be classified using powerful classification tools like deep learning. In this study, range-Doppler images of behind-the-wall human movements obtained with a radar system consisting of one transmitter and four receiver antennas were classified. Since the data collected from the four receiver antennas are in different positions, the collected reflection signals also differ. The signals collected with the range-time matrix content were divided into positive and negative parts, resulting in eight images from the four antennas. Instead of using all the data in CNN training, the images were first subjected to a reconstruction process with an autoencoder to reduce differences. As a result, it was observed that reconstructing the images with an autoencoder before classification with CNN increased the classification success. In conclusion, it was observed that the classification success of radar images can be increased by using a hybrid system with an autoencoder to reconstruct the images before classification with CNN.

Keywords

• Autoencoder Reconstruction
• Behind-the-Wall Monitoring
• CNN Classification
• Human Movement Tracking
• Radar Systems

References

1. [1] W. Heng, S. Solomon, and W. Gao, "Flexible electronics and devices as human–machine interfaces for medical robotics," Advanced Materials, vol. 34, no. 16, p. 2107902, 2022.
2. [2] M. Javaid, A. Haleem, S. Rab, R. P. Singh, and R. Suman, "Sensors for daily life: A review," Sensors International, vol. 2, p. 100121, 2021.
3. [3] D. S. Nunes, P. Zhang, and J. S. Silva, "A survey on human-in-the-loop applications towards an internet of all," IEEE Communications Surveys & Tutorials, vol. 17, no. 2, pp. 944-965, 2015.
4. [4] J. B. Awotunde, R. G. Jimoh, S. O. Folorunso, E. A. Adeniyi, K. M. Abiodun, and O. O. Banjo, "Privacy and security concerns in IoT-based healthcare systems," in Internet of Things, Cham: Springer International Publishing, 2021, pp. 105-134.
5. [5] A. E. Onoja, A. M. Oluwadamilola, and L. A. Ajao, "Embedded system based radio detection and ranging (RADAR) system using Arduino and ultra-sonic sensor," American Journal of Embedded Systems and Applications, vol. 5, no. 1, pp. 7-12, 2017.
6. [6] A. Biswas, S. Abedin, and M. A. Kabir, "Moving object detection using ultrasonic radar with proper distance, direction, and object shape analysis," Journal of Information Systems Engineering and Business Intelligence, vol. 6, no. 2, pp. 99-111, 2020.
7. [7] M. I. Skolnik, "Introduction to radar," Radar handbook, vol. 2, p. 21, 1962.
8. [8] A. M. Ponsford, L. Sevgi, and H. C. Chan, "An integrated maritime surveillance system based on high-frequency surface-wave radars. 2. Operational status and system performance," IEEE Antennas and Propagation Magazine, vol. 43, no. 5, pp. 52-63, 2001.

9. [9] A. Reigber et al., "Very-high-resolution airborne synthetic aperture radar imaging: Signal processing and applications," Proceedings of the IEEE, vol. 101, no. 3, pp. 759-783, 2012.
10. [10] S. Hazra and A. Santra, "Short-range radar-based gesture recognition system using 3D CNN with triplet loss," IEEE Access, vol. 7, pp. 125623-125633, 2019.
11. [11] Y. E. Acar, K. Ucar, I. Saritas, and E. Yaldiz, "Classification of human target movements behind walls using multi-channel range-doppler images," Multimedia Tools and Applications, pp. 1-18, 2023.
12. [12] X. Li, Y. He, and X. Jing, "A survey of deep learning-based human activity recognition in radar," Remote Sensing, vol. 11, no. 9, p. 1068, 2019.
13. [13] H. T. Le, S. L. Phung, and A. Bouzerdoum, "Human gait recognition with micro-Doppler radar and deep autoencoder," in 2018 24th International Conference on Pattern Recognition (ICPR), 2018: IEEE, pp. 3347-3352.
14. [14] Y. Shao, S. Guo, L. Sun, and W. Chen, "Human motion classification based on range information with deep convolutional neural network," in 2017 4th International Conference on Information Science and Control Engineering (ICISCE), 2017: IEEE, pp. 1519-1523.
15. [15] P. van Dorp and F. Groen, "Feature-based human motion parameter estimation with radar," IET Radar, Sonar & Navigation, vol. 2, no. 2, pp. 135-145, 2008.
16. [16] A. Sume et al., "Radar detection of moving targets behind corners," IEEE Transactions on Geoscience and Remote Sensing, vol. 49, no. 6, pp. 2259-2267, 2011.
17. [17] X. Li, Z. Li, F. Fioranelli, S. Yang, O. Romain, and J. L. Kernec, "Hierarchical radar data analysis for activity and personnel recognition," Remote Sensing, vol. 12, no. 14, p. 2237, 2020.
18. [18] J. Wang, Y. Chen, S. Hao, X. Peng, and L. Hu, "Deep learning for sensor-based activity recognition: A survey," Pattern recognition letters, vol. 119, pp. 3-11, 2019.
19. [19] M. Zenaldin and R. M. Narayanan, "Radar micro-Doppler based human activity classification for indoor and outdoor environments," in Radar Sensor Technology XX, 2016, vol. 9829: SPIE, pp. 364-373.
20. [20] F. Qi, H. Lv, F. Liang, Z. Li, X. Yu, and J. Wang, "MHHT-based method for analysis of micro-Doppler signatures for human finer-grained activity using through-wall SFCW radar," Remote Sensing, vol. 9, no. 3, p. 260, 2017.
21. [21] M. He, Y. Nian, and Y. Gong, "Novel signal processing method for vital sign monitoring using FMCW radar," Biomedical Signal Processing and Control, vol. 33, pp. 335-345, 2017.
22. [22] I. Seflek, Y. E. Acar, and E. Yaldiz, "Small motion detection and non-contact vital signs monitoring with continuous wave doppler radars," Elektronika ir elektrotechnika, vol. 26, no. 3, pp. 54-60, 2020.
23. [23] G. Diraco, A. Leone, and P. Siciliano, "A radar-based smart sensor for unobtrusive elderly monitoring in ambient assisted living applications," Biosensors, vol. 7, no. 4, p. 55, 2017.
24. [24] F. Fioranelli, J. Le Kernec, and S. A. Shah, "Radar for health care: Recognizing human activities and monitoring vital signs," IEEE Potentials, vol. 38, no. 4, pp. 16-23, 2019.
25. [25] K. Hanifi and M. E. Karsligil, "Elderly fall detection with vital signs monitoring using CW Doppler radar," IEEE Sensors Journal, vol. 21, no. 15, pp. 16969-16978, 2021.
26. [26] S. Z. Gurbuz and M. G. Amin, "Radar-based human-motion recognition with deep learning: Promising applications for indoor monitoring," IEEE Signal Processing Magazine, vol. 36, no. 4, pp. 16-28, 2019.
27. [27] S. Nag, M. A. Barnes, T. Payment, and G. Holladay, "Ultrawideband through-wall radar for detecting the motion of people in real time," in Radar Sensor Technology and Data Visualization, 2002, vol. 4744: SPIE, pp. 48-57.
28. [28] A. Krizhevsky and G. E. Hinton, "Using very deep autoencoders for content-based image retrieval," in ESANN, 2011, vol. 1: Citeseer, p. 2.
29. [29] Z. Zhu, X. Wang, S. Bai, C. Yao, and X. Bai, "Deep learning representation using autoencoder for 3D shape retrieval," Neurocomputing, vol. 204, pp. 41-50, 2016.
30. [30] T. Liu, J. Wang, Q. Liu, S. Alibhai, T. Lu, and X. He, "High-ratio lossy compression: Exploring the autoencoder to compress scientific data," IEEE Transactions on Big Data, vol. 9, no. 1, pp. 22-36, 2021.
31. [31] Y. Jiang, H. Kim, H. Asnani, S. Kannan, S. Oh, and P. Viswanath, "Turbo autoencoder: Deep learning based channel codes for point-to-point communication channels," Advances in neural information processing systems, vol. 32, 2019.
32. [32] D. Bhatt et al., "CNN variants for computer vision: History, architecture, application, challenges and future scope," Electronics, vol. 10, no. 20, p. 2470, 2021.
33. [33] Y. E. Acar, I. Saritas, and E. Yaldiz, "An experimental study: Detecting the respiration rates of multiple stationary human targets by stepped frequency continuous wave radar," Measurement, vol. 167, p. 108268, 2021.