Airborne imagery and lidar based 3D reconstruction using commercial drones

Abstract

In the study, the implementation of 3D reconstruction of buildings using drones is explained. In this project, Airsim was used as the simulation environment and images were obtained from the simulation environment using OpenCV and the Meshroom software was run on these images and modeling was done in the computer environment. For real-world studies, the engineering faculty in Ankara University 50. Yıl Campus was modeled using photogrammetry technique. In the last part, the results of different modelling algorithms were compared.

Keywords

• Drones
• 3D reconstruction
• algorithms

References

1. Moons, T., Van Gool, L., Vergauwen, M., 3D reconstruction from multiple images part 1: Principles, Found. Trends Comput. Graph. Vis., 4 (4) (2010), 287-404.
2. Yastıklı, N., Çetin, Z., Üçok, U., Koçdemir, K. H., Fotogrametrik harita ve LiDAR verileri ile 3B kent modeli üretimi, TMMOB Harita ve Kadastro Mühendisleri Odası, 16. Türkiye Harita Bilimsel ve Teknik Kurultayı, Ankara,(2017).
3. Tasa, U. B., İçeriği Kullanıcılar Tarafından Oluşturulan 3 Boyutlu Sanal Dünyalarda Sanat ve Mimari Tasarım: Second Life Üzerine Bir Vaka Çalışması, (2009). Master Thesis, Yıldız Teknik Üniversitesi, Türkiye.
4. Abualigah, L., Diabat, A., Sumari, P., Gandomi, A. H., Applications, deployments, and integration of internet of drones (IoD): A review, IEEE Sens. J., 21 (22) (2021), 25532-25546.
5. Ayamga, M., Akaba, S., Nyaaba, A. A., Multifaceted applicability of drones: A review, Technol. Forecast. Soc. Change, 167 (2021), 120677, https://doi.org/10.1016/j.techfore.2021.120677.
6. Lamptey, E., Serwaa, D., The use of zipline drones technology for COVID-19 samples transportation in Ghana, HighTech Innov. J., 1 (2) (2020), 67-71, https://doi.org/10.28991/HIJ-2020-01-02-03.
7. Konert, A., Balcerzak, T., Military autonomous drones (UAVs) - from fantasy to reality. Legal and Ethical implications, Transp. Res. Proc., 59 (2021), 292-299, https://doi.org/10.1016/j.trpro.2021.11.121.
8. Bai, O., Chu, H., Drones in education: A critical review, Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12 (11) (2021), 1722-1727.

9. Unal, M., Bostanci, E., Sertalp, E., Distant augmented reality: Bringing a new dimension to user experience using drones, Digit. Appl. Archaeol. Cult. Heritage, 17 (2020), e00140, https://doi.org/10.1016/j.daach.2020.e00140.
10. Unal, M., Unal, F. Z., Bostanci, E., Guzel, M. S., Augmented reality and new opportunities for cultural heritage, Augmented Reality in Tourism, Museums and Heritage, Springer, Cham, 2021, 213-225.
11. Andriolo, U., Gonçalves, G., Rangel-Buitrago, N., Paterni, M., Bessa, F., Gonçalves, L. M. S., et al., Drones for litter mapping: An inter-operator concordance test in marking beached items on aerial images, Mar. Pollut. Bull., 169 (2021), 112542, https://doi.org/10.1016/j.marpolbul.2021.112542.
12. Aydın, M., Bostancı, E., Güzel, M. S., Kanwal, N., Multiagent systems for 3D reconstruction applications, Multi Agent Systems - Strategies and Applications, IntechOpen, London, 2020, https://doi.org/10.5772/intechopen.88460.
13. Lee, J., Hong, S., Cho, H., Park, I., Cho, H., Sohn, H.-G., Accuracy comparison between image-based 3D reconstruction technique and terrestrial LIDAR for as-built BIM of outdoor structures, J. Korean Soc. Surv. Geod. Photogramm. Cartogr., 33 (2015), 557-567, https://doi.org/10.7848/ksgpc.2015.33.6.557.
14. Wingtra, Drone photogrammetry vs. LIDAR: what sensor to choose for a given application, (2021). Available at: https://wingtra.com/drone-photogrammetry-vsLIDAR/. [Accessed October 2022].
15. Milioto, A., Vizzo, I., Behley, J., Stachniss, C., Rangenet++: Fast and accurate LiDAR semantic segmentation, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), (2019), 4213-4220.
16. Raj, T., Hashim, F. H., Huddin, A. B., Ibrahim, M. F., Hussain, A., A survey on LiDAR scanning mechanisms, Electronics, 9 (5) (2020), 741.
17. Senol, H. I., Yiğit, A. Y., Kaya, Y., Ulvi, A., İHA ve yersel fotogrametrik veri füzyonu ile kültürel mirasın 3 boyutlu (3B) modelleme uygulaması: Kanlıdivane örneği, Türkiye Fotogrametri Dergisi, 3 (1) (2021), 29-36.
18. Ulvi, A., Yakar, M., Yiğit, A., Kaya, Y., İHA ve yersel fotogrametrik teknikler kullanarak aksaray kızıl kilisenin 3b modelinin ve nokta bulutunun elde edilmesi, Geomatik, 5 (1) (2020), 19-26, https://doi.org/10.29128/geomatik.560179.
19. Microsoft Research Github Web Page, "Airsim," (2022). Available at: https://microsoft.github.io/AirSim/. [Accessed October 2022].
20. Reutebuch, S. E., Andersen, H. E., McGaughey, R. J., Light detection and ranging (LIDAR): An emerging tool for multiple resource inventory, J. For., 103 (6) (2005), 286-292.
21. Bradski, G., The OpenCV Library, Dr. Dobb’s Journal of Software Tools, (2000).
22. DJI, DJI Drones, (2022). Available: https://www.dji.com/. [Accessed October 2022].