Autonomous 3D Target Tracking via UAV

Abstract

In recent years, unmanned aerial vehicles (UAVs) have been integrated into many applications. These vehicles are used by the governments and the private sector for many different purposes. Some of the popular applications are field scanning, target tracking, defense markets, search and rescue, map creation, underground resource search, photography or entertainment. Recently many academic institutions have shown significant amount of interest in this field and many of them have established aviation departments and societies. In addition, many thesis studies and academic publications related to UAVs have been presented. The aim of this particular study is to detect a small object identified as a target by UAV and to provide autonomous tracking of the detected target in three axes. As the outcome of this work, the UAV is coded to lock on the target and maintain a fixed distance on the x, y and z axes after the initial lock. Within the scope of the study, a functional system was designed by evaluating the most important parameters for UAVs such as weight, cost and flight time. An algorithm was designed that uses the image processing methods to detect the target and movement direction of the target, and utilizes MAVLink communication protocol to control the UAV. In addition, two different tests and test results corresponding to two distinct methods were reported which were done to keep the distance constant on the z-axis by using an external distance sensor or comparison algorithm. The project was successfully implemented using single camera only.

Keywords

• Unmanned aerial vehicle
• UAV
• Autonomous system
• 3D tracking
• image processing
• fast algorithm

References

1. [1] R. Barták, A. Vyškovský, "Any Object Tracking and Following by a Flying Drone." Fourteenth Mexican International Conference on Artificial Intelligence. Cuernavaca, US, 2015.
2. [2] A. Hinas, J.M. Roberts, F. Gonzales, "Vision-Based Target Finding and Inspection of a Ground Target Using a Multirotor UAV System", Sensors, vol. 17, no.12, 2017, pp. 1-17.
3. [3] A. Audi, M. Pierrot-Deseilligny, C. Meynard, C. Thom, "Implementation of an IMU Aided Image Stacking Algorithm in a Digital Camera for Unmanned Aerial Vehicles", Sensors, vol. 17, no.7, 2017, pp. 1-21.
4. [4] J. Junell, E.J. Kampen, C. Visser, Q. Chu, "Reinforcement Learning Applied to a Quadrotor Guidance Law in Autonomous Flight." AIAA Guidance, Navigation, and Control Conference, Florida, US, 2015.
5. [5] A. Mashood, A. Dirir, M. Hussein, H. Noura, F. Awwad, "Quadrotor Object Tracking using Real-Time Motion Sensing." 5th International Conference on Electronic Devices, Systems, and Applications, Ras Al Khaimah, United Arab Emirates, December 2016.
6. [6] D. A. Mercado-Ravell, P. Castillo and R. Lozano, "Visual Detection and Tracking with UAVs, Following a Mobile Object", Advanced Robotics, vol.33, pp. 1-15, 2019.
7. [7] M. Lutz, Learning Python, O’Reilly Media, 2007, California, pp.700.
8. [8] S. Brahmbhatt, Practical OpenCV, Apress, USA, pp.223.

9. [9] R. Chityala, S. Pudipeddi, Image Processing and Acquisition using Python, CRC Press, Florida, pp.350.
10. [10] A. Mordvintsev, K. Abid, Changing Colorspaces. Accessed: Jul. 2019. [Online]. Available: https://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_imgproc/py_colorspaces/py_colorspaces.html
11. [11] OpenCV, Thresholding Operations using inRange. Accessed: Jul. 2019. [Online]. Available: https://docs.opencv.org/3.4/da/d97/tutorial_threshold_inRange.html
12. [12] OpenCV, Smoothing Images. Accessed: Jul. 2019. [Online]. Available: https://docs.opencv.org/3.4.2/d4/d13/tutorial_py_filtering.html
13. [13] A. Koschan, M. Abidi, Digital Color Image Processing, John Wiley & Sons, Inc., New Jersey, US, pp.375.
14. [14] B. Jähne, Digital Image Processing, 6th, revised and extended edition, 2005, Springer, Berlin, Germany, pp.607.
15. [15] W.K. Pratt, Digital Image Processing : PIKS Scientific inside, 4th edition, 2001, John Wiley&Sons, Inc., New Jersey, US, pp.807.
16. [16] OpenCV, Morphological Transformations. Accessed: Aug. 2019. [Online]. Available: https://docs.opencv.org/3.4.2/d9/d61/tutorial_py_morphological_ops.html
17. [17] R. Gamasu, V.R.B. Jasti, "Robust Cohen-Coon PID Controller for Flexibility of Double Link Manipulator", International Journal of Control and Automation, vol. 7, no.1, 2014, pp. 357-368.
18. [18] ‎K.J. Åström, T. Hägglund, PID Controllers: Theory, Design, and Tuning, 2nd edition, Instrument Society of America, 1995, USA, pp.338.
19. [19] S. Atoev, K. Kwon, S. Lee, K. Moon, "Data Analysis of the MAVLink Communication Protocol." International Conference on Information Science and Communications Technologies. Tashkent, Uzbekistan, 2017.
20. [20] Raspberry pi, Camera Module. Accessed: May. 2019. [Online]. Available: https://www.raspberrypi.org/documentation/hardware/camera/
21. [21] J. Case, Astro Navigation Demystified, Revised edition, Bookcase Learning Resources, 2016, Weymouth, UK, pp. 324.
22. [22] A. Singh, Latitude and Longitude are angles, not just some numbers on the earth’s surface. Accessed: Aug. 2019. [Online]. Available: https://medium.com/@atinders/latitude-and-longitude-are-angles-not-just-some-numbers-on-the-earths-surface-d16019aaf24a
23. [23] J. Laconte, S. Deschênes, M. Labussière, F. Pomerleau, "Lidar Measurement Bias Estimation via Return Waveform Modelling in a Context of 3D Mapping." International Conference on Robotics and Automation. Montreal, Canada, 2019.
24. [24] X. Li, Y. Guo, "Application of LiDAR Technology in Power Line Inspection." International Conference on Advanced Materials, Intelligent Manufacturing and Automation. China, 2018.
25. [25] G. Duh. Light Detection and Ranging (LiDAR), Lecture notes. Portland State University.
26. [26] N.A. Latha, B. R. Murthy, K. B. Kumar, "Distance Sensing with Ultrasonic Sensor and Arduino", International Journal of Advance Research, Ideas and Innovations in Technology, vol. 2, no.5, 2016, pp. 1-5.
27. [27] A. Pantano, D. Cerniglia, "Simulation of laser-generated ultrasonic wave propagation in solid media and air with application to NDE", Applied Physics A, vol. 98, no.2, 2010, pp. 327-336.