Madencilik Makinelerinin Eğitiminde Artırılmış ve Karma Gerçekliğin Kullanımı

Yıl 2024, Cilt: 5 Sayı: 2, 48 - 56

Kaan Erarslan , Mehmet Özdemir

https://doi.org/10.53608/estudambilisim.1583427

Öz

Artırılmış ve karma gerçeklik, başta eğitim olmak fen bilimleri, sağlık ve mühendislik gibi birçok disiplinde kullanılmaktadır. Kendisine özgü donanım ve yazılımlarıyla sanal grafik tasarımların doğal çevre içinde görüntülenmesine ve etkileşimine dayanmaktadır. Bu çalışmada, açık ocak maden makinelerinin eğitiminde, artırılmış (AR) ve karma gerçeklik (MR) uygulamalarının etkisi incelenmektedir. AR Book olarak adlandırılan uygulamada, makine görselleri ve teknik bilgilerinin yer aldığı bir kitapçık oluşturulmuştur. Unity gerçek zamanlı geliştirme motorunda geliştirilen projede, Vuforia AR motorunda oluşturulan veri tabanı ve bunlarla eşleştirilen 3 boyutlu makine modelleri kullanılmıştır. Android cihazlar kullanılarak bu kitapçık üzerinde görüntü-hedefi tabanlı artırılmış gerçeklik uygulaması tatbik edilmiştir. Diğer uygulamada karma gerçeklik cihazı olan MS Hololens 2 için zemin-düzlem tabanlı bir uygulama geliştirilmiştir. El etkileşim özelliği ile gerçek çevrede konumlandırılan makineler sürükleme, döndürme ve ölçeklendirme işlemleriyle kontrol edilebilmekte, devasa boyutlara büyütülüp incelenebilmektedir. Eğitim alan grubun AR ve MR uygulamalarının geleneksel eğitimle birlikte kullanılması hususundaki değerlendirmelerine başvurulmuştur. Ayrıca mobil cihaz ve Hololens 2 arasında da kıyaslama yapmaları istenmiştir. Görüntüleme teknolojilerinin eğitime entegre edilmesi hususunda yüksek derecede olumlu sonuçlar alınmıştır.

Anahtar Kelimeler

Madencilik Makineleri, Artırılmış Gerçeklik, Karma Gerçeklik, AR Kitabı, Hololens 2

Destekleyen Kurum

Kütahya Dumlupınar Üniversitesi

Proje Numarası

DPÜ-BAP 2022-63

Utilization of Augmented and Mixed Reality in Training Mining Machines

Öz

Augmented reality (AR) and mixed reality (MR) are used in many disciplines, especially education, science, health, safety and engineering. It is based on the visualization and interaction of virtual graphic designs in the natural environment with its own hardware and software. In this study, the effect of augmented and mixed reality applications in the training of open-pit mining machines is examined. In the application called AR Book, a booklet containing machine visuals and technical information was created. In the project developed in the Unity real-time development engine, the database created in the Vuforia AR engine and 3D machine models matched with them were used. An image-target-based augmented reality application was implemented in this booklet using Android devices. In another application, a ground-plane-based application was developed for the mixed reality device MS Hololens 2. With the Hand Interactions feature, machines positioned in the natural environment can be controlled with drag, rotate and scale operations, enlarged to gigantic sizes and examined. The evaluations of the training group regarding the use of AR and MR applications together with traditional education were sought. They were also asked to make comparisons between the mobile device and Hololens 2. There have been highly positive results in integrating imaging technologies into education.

Anahtar Kelimeler

Mining Machines, Augmented Reality, Mixed Reality, AR Book, Hololens 2

Proje Numarası

DPÜ-BAP 2022-63

Kaynakça

• Yang, F., & Goh, Y. M. 2022. VR and MR technology for safety management education: An authentic learning approach. Safety Science, 148, 105645.
• Rokooei, S., Shojaei, A., Alvanchi, A., Azad, R., & Didehvar, N. 2023. Virtual reality application for construction safety training. Safety Science, 157, 105925.
• Gürer, S., Surer, E., & Erkayaoğlu, M. 2023. MINING-VIRTUAL: A comprehensive virtual reality-based serious game for occupational health and safety training in underground mines. Safety science, 166, 106226.
• Eiris, R., Gheisari, M., & Esmaeili, B. 2020. Desktop-based safety training using 360-degree panorama and static virtual reality techniques: A comparative experimental study. Automation in construction, 109, 102969.
• Chen, H., Hou, L., Zhang, G. K., & Moon, S. 2021. Development of BIM, IoT and AR/VR technologies for fire safety and upskilling. Automation in Construction, 125, 103631.
• Hussain, R., Sabir, A., Lee, D. Y., Zaidi, S. F. A., Pedro, A., Abbas, M. S., & Park, C. 2024. Conversational AI-based VR system to improve construction safety training of migrant workers. Automation in Construction, 160, 105315.
• Alam, M. F., Katsikas, S., Beltramello, O., & Hadjiefthymiades, S. 2017. Augmented and virtual reality based monitoring and safety system: A prototype IoT platform. Journal of Network and Computer Applications, 89, 109-119.
• Sudiarno, A., Dewi, R. S., Widyaningrum, R., Ma'arij, A. M. D., & Supriatna, A. Y. 2024. Investigating the Future Study Area on VR Technology Implementation in Safety Training: A Systematic Literature Review. Journal of Safety Science and Resilience.
• Yoo, J. W., Park, J. S., & Park, H. J. 2023. Understanding VR-based construction safety training effectiveness: The role of telepresence, risk perception, and training satisfaction. Applied Sciences, 13(2), 1135.
• Afzal, M., & Shafiq, M. T. 2021. Evaluating 4D-BIM and VR for effective safety communication and training: a case study of multilingual construction job-site crew. Buildings, 11(8), 319.
• Shringi, A., Arashpour, M., Golafshani, E. M., Rajabifard, A., Dwyer, T., & Li, H. 2022. Efficiency of VR-based safety training for construction equipment: Hazard recognition in heavy machinery operations. Buildings, 12(12), 2084.
• Don-Hee, L. E. E., Min, Y. I., Kim, J. S., & Kim, J. J. 2021. A Study on Excavator Detection to prevent gas lines digging accident based on Faster R-CNN and Drone/AR. Turkish Online Journal of Qualitative Inquiry, 12(7).
• Manzoor, B., Othman, I., Pomares, J. C., & Chong, H. Y. 2021. A research framework of mitigating construction accidents in high-rise building projects via integrating building information modeling with emerging digital technologies. Applied Sciences, 11(18), 8359.
• Albeaino, G., Brophy, P., Gheisari, M., Issa, R. R., & Jeelani, I. 2022. Working with Drones: Design and Development of a Virtual Reality Safety Training Environment for Construction Workers. In Computing in Civil Engineering 2021 (pp. 1335-1342).
• Zhang, C., Wang, X., Fang, S., & Shi, X. 2022. Construction and application of VR-AR teaching system in coal-based Energy Education. Sustainability, 14 (23), 16033.
• Tarkkanen, K., Lehto, A., Oliva, D., Somerkoski, B., Haavisto, T., & Luimula, M. 2020. Research study design for teaching and testing fire safety skills with AR and VR games. In 2020 11th IEEE International Conference on Cognitive Infocommunications (CogInfoCom) (pp. 000167-000172). IEEE.
• Singh, P., Murthy, V., Kumar, D., & Raval, S. 2024. A comprehensive review on application of drone, virtual reality and augmented reality with their application in dragline excavation monitoring in surface mines. Geomatics, Natural Hazards and Risk, 15(1), 2327399.
• Scianna, A., Gaglio, G. F., & La Guardia, M. 2020. Digital photogrammetry, TLS survey and 3D modelling for VR and AR applications in CH. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 43, 901-909.
• Comes, R., Neamțu, C. G. D., Grec, C., Buna, Z. L., Găzdac, C., & Mateescu-Suciu, L. 2022. Digital Reconstruction of Fragmented Cultural Heritage Assets: The Case Study of the Dacian Embossed Disk from Piatra Roșie. Applied Sciences, 12(16), 8131.
• Van Nguyen, S., Le, S. T., Tran, M. K., & Tran, H. M. 2022. Reconstruction of 3D digital heritage objects for VR and AR applications. Journal of Information and Telecommunication, 6(3), 254-269.
• Kelly, l. 2022. The Drift: Device bringing augmented reality to the mining face. Northern Ontario Business. https://www.northernontariobusiness.com/industry-news/mining/the-driftdevice-bringing-augmented-reality-to-the-mining-face-577244.
• Fang, J., Fan, Wang, F., Bai, D. 2022. Augmented Reality Platform for the Unmanned Mining Pro¬cess in Underground Mines. Mining, Metallurgy and Exploration. Vol. 39, p. 385-395.
• Michalak, D. 2012. Applying the augmented reality and RFID technologies in the maintenance of mining machines. Lecture Notes in Engineering and Computer Science, 1, 256–260.
• Hugues, O., Gbodossou, A., & Cieutat, J.-M. 2012. Towards the Application of Augmented Reality in the Mining Sector: Open-Pit Mines. International Journal of Applied Information Systems, 4(6), 27-32. https://doi.org/10.5120/ijais12-450760.
• Demirkan, D. C., & Duzgun, S. 2020. An evaluation of AR-assisted navigation for search and rescue in underground spaces. In 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 1-2). IEEE.
• Valencia Quiceno, J. D., Kecojevic, V., McBrayer, A., & Bogunovic, D. 2024. Augmented Reality System for Training of Heavy Equipment Operators in Surface Mining. Mining, Metallurgy & Exploration, 41(5), 2217-2229.
• Wu, S., Hou, L., Zhang, G. K., & Chen, H. 2022. Real-time mixed reality-based visual warning for construction workforce safety. Automation in Construction, 139, 104252.
• Liu, S., Xie, J., Wang, X., & Meng, H. 2023. Mixed Reality collaboration environment improves the efficiency of human-centered industrial system: A case study in the mining industry. Computers & Industrial Engineering, 180, 109257.
• Li, W., Wang, Y., Yang, H., Ye, Z., Li, P., Liu, Y. A., & Wang, L. 2023. Development of a mixed reality method for underground pipelines in digital mechanics experiments. Tunnelling and Underground Space Technology, 132, 104833.
• Altan, B., Gürer, S., Alsamarei, A., Demir, D. K., Düzgün, H. Ş., Erkayaoğlu, M., & Surer, E. 2022. Developing serious games for CBRN-e training in mixed reality, virtual reality, and computer-based environments. International Journal of Disaster Risk Reduction, 77, 103022.
• Mysiorek, J., Stead, D., Chang, O., Donati, D., Rosser, N., & Onsel, I. E. 2022. Virtual and Mixed Reality Geodatabases: The Importance of Integrating Engineering Geological Field Techniques with New Methods for Site Characterization. In GeoCalgary 2022" Reflection on Resources" (pp. 1-8).
• Onsel, E. I., Stead, D., Barnett, W., Zorzi, L., & Shaban, A. 2020. Innovative mixed reality approach to rock mass mapping in underground mining. In MassMin 2020: Proceedings of the Eighth International Conference & Exhibition on Mass Mining (pp. 1375-1383). University of Chile.
• Demirkan, D. C., Segal, A., Mallik, A., Duzgun, S., & Petruska, A. J. 2024. Real-time perception enhancement in obscured environments for underground mine search and rescue teams. AI, Computer Science and Robotics Technology, (23).
• Kaspar, M., Kieffer, D. S., & Liu, Q. 2023. Holographic mixed reality: an enhanced technology for visualizing and evaluating complex 3D geologic data. In ISRM Congress (pp. ISRM-15CONGRESS). ISRM.
• Jing, H., Zhang, X., Liu, X., Sun, X., & Ma, X. 2021. Research on emergency escape system of underground mine based on mixed reality technology. Arabian Journal of Geosciences, 14(8), 728.
• Dragline TurboSquid 3D Model, 2024. https://www.turbosquid.com/3d-model/dragline-excavator.
• Bucket Wheel Excavator Bagger, 2024. https://www.turbosquid.com/3d-models/bagger-293-bucket-wheel-3d-1678167.
• Cable Shovel Excavator, Sketchfab, 2024. https://sketchfab.com/3d-models/3d-model-cat-7795-hf-2-c2368bc688d346b7af3bdbaae73d21e0.
• Off Highway Truck, 2024. https://www.heavy-equipmentmanual.com/products/download-caterpillar-789g-off-highway-truck-parts-manual-tr2.
• Big Excavator, Grabcad 3D Model, 2024. https://grabcad.com/library/excavator-o-k-rh900-evo-1.
• Back-hoe Excavator Shovel, 2024. https://www.cgtrader.com/3d-models/industrial/industrial-machine/cat-shovel-excavator-cat-6190.
• Blast Hole Drilling Machine 3D, 2024. https://free3d.com/3d-model/rotary-blasthole-drill-9361.html.
• Grader 3D, 2024. https://www.lectura-specs.com/en/model/construction-machinery/graders-caterpillar/120-gc-awd-11758997.
• Wheel Loader, Front End Loader, 2024. https://www.indiamart.com/proddetail/wheel-loader-5-ton-11760030597.html.
• Crawler Loader Bulldozer 3D Model, 2024. https://www.theconstructionindex.co.uk/the-digger-blog/view/introducing-cats-new-16-tonne-crawler-loader.
• Articulated Truck 3D Model, 2024. https://www.mustangcat.com/es/products/new-caterpillar-products/equipment/articulated-trucks/745-articulated-truck/.
• Articulated Truck Volvo A40G, 2024. https://3dwarehouse.sketchup.com/model/d30d3ac11595c0de49bbcfe49534b487/Volvo-dump-truck-articulated.
• Back-hoe Excavator, CAT 6190FS, 2024. https://3dwarehouse.sketchup.com/model/aa544814-7d36-419b-9f28-34e7abcd193a/excavator-backhoe-cat-6190-fs.
• Wheel Front End Loader CAT994k XL, 2024. https://3dwarehouse.sketchup.com/model/e0885077-3de9-4ca9-b3c3-9af6d844f5c6/caterpillar-994k-XL-coal-Wheel-Loaders.
• Bucket Wheel Excavator, 2024. https://rigmodels.com/model.php?view=Mining_Machine-3d-model__a7a9d4e1828045abaa92e2dd16355c71&searchkeyword=bucketwheel%20excavator&manualsearch=1.
• Shovel Excavator CAT 6190, 2024. https://3dwarehouse.sketchup.com/model/5a13bcec-e128-442e-bdf2-32621b50db8b/shovel-excavator-cat-6190-fs.
• Caterpillar Off Highway Truck 789C, 2024. https://3dwarehouse.sketchup.com/model/67602579-4919-4b17-9558-d288d1ce62ab/Caterpillar.
• Crawler Loader Caterpillar-953D, 2024. https://3dwarehouse.sketchup.com/model/1c69c00c12e7a59578fe949fc1419876/Caterpillar-953D-Track-Loader.
• Dragline Excavator Bucyrus-Erie 24, 2024. https://rigmodels.com/model.php?view=Bucyrus_Erie_Class_24_dragline_excavator-3d-model__45fe0a28b61b4160a2b962d019dc7b78&searchkeyword=dragline&manualsearch=1.
• Blast Hole Drilling Rig Sany SR250, 2024. https://sketchfab.com/3d-models/sany-sr250-b6aab8e9328c4b7080d8b0d3bd8ebf79.
• Grader Caterpillar 24H Motor, 2024. https://3dwarehouse.sketchup.com/model/8f4beb6ad3d9e4686b0b63eb80b753d0/Caterpillar-24H-Motor-Grader.
• Articulated Truck Caterpillar 730C, 2024. https://3dwarehouse.sketchup.com/model/u0645ef5f-a333-436a-bcac-f7f9009c53f8/Caterpillar-730-c.