Evaluating the Effectiveness of AI-Powered Conversational Models in Construction Management Education: A Comparative Investigation of Student Performances and ChatGPT

Öz

This study examines the impact of one of the AI conversational tools, ChatGPT-4, on learning outcomes in construction management courses. Focusing on the Site Management course, the same exam questions were administered to both students and ChatGPT-4. This evaluation was conducted in two phases—midterm and final exams—where the performances of both ChatGPT-4 and the students were compared and analyzed. The research reveals that while the AI outperformed students in the midterm exam, it showed a decline in performance during the final exam, indicating limitations in adapting to different exam environments. Neither ChatGPT-4 nor the students met the course passing criteria. The study emphasizes the need for further development of AI for more effective integration into education, with a focus on considering ethical dimensions in this process.

Anahtar Kelimeler

• AI
• Education
• ChatGPT
• Construction Management

Yapay Zekâ Destekli Konuşma Modellerinin Yapım Yönetimi Eğitimindeki Etkililiğinin Değerlendirilmesi: ChatGPT ve Öğrenci Performanslarının Karşılaştırmalı Bir İncelemesi

Öz

Bu çalışma, yapay zekâ konuşma araçlarından ChatGPT-4'ün yapı işletmesi derslerindeki öğrenme başarılarına etkilerini incelemektedir. Şantiye Tekniği dersi özelinde, öğrenciler ve ChatGPT-4'e aynı sınav soruları uygulanmıştır. Ara sınav ve final sınavı olmak üzere iki aşamada yapılan bu değerlendirmede, hem ChatGPT-4'ün hem de öğrencilerin performansları karşılaştırılarak analiz edilmiştir. Araştırma, yapay zekânın ara sınavda öğrencilerden daha iyi performans gösterdiğini, ancak final sınavında düşüş yaşadığını, bu nedenle farklı sınav ortamlarına uyum sağlamakta sınırlamalar olduğunu ortaya koymaktadır. Hem ChatGPT-4 hem de öğrenciler dersin geçme kriterlerini karşılayamamıştır. Çalışma, yapay zekanın eğitimde daha etkili entegrasyonu için geliştirilmesi ve bu süreçte etik boyutların göz önünde bulundurulması gerektiğini vurgulamaktadır.

Anahtar Kelimeler

• AI
• Eğitim
• ChatGPT
• Yapı işletmesi

Kaynakça

1. Abdel-Kader MY., Ebid AM., Onyelowe KC., Mahdi IM., Abdel-Rasheed I. (AI) in Infrastructure Projects-Gap Study. Infrastructures 2022; 7(10): 137.
2. Ai X. The construction of an online education platform under the background of big data and ıntelligent data ınteraction: the realization of ınteraction based on C#. In 2022 Second International Conference on Artificial Intelligence and Smart Energy (ICAIS) 2022; 545–548. IEEE.
3. Aliu J., Aigbavboa C. Reviewing the trends of construction education research in the last decade: a bibliometric analysis. International Journal of Construction Management 2023; 23(9): 1571–1580.
4. Aluga M. Application of CHATGPT in civil engineering. East African Journal of Engineering 2023; 6(1): 104–112.
5. Burgoon JM., Roebuck A., Elliott JW. Evidence of opportunity gaps in construction education: a longitudinal analysis of student success. International Journal of Construction Education and Research 2024; 20(1): 83–97.
6. Cao Y., Li S. Liu Y., Yan Z., Dai Y., Yu PS., Sun L. A comprehensive curvey of AI-generated content (AIGC): A history of generative AI from GAN to ChatGPT 2023.
7. Chen L., Chen P., Lin Z. Artificial intelligence in education: A review. IEEE Access 2020; 8: 75264–75278.
8. Credé M., Kuncel NR. Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on Psychological Science 2008; 3(6): 425–453.

9. de Winter JCF. Can ChatGPT pass high school exams on English language comprehension? International Journal of Artificial Intelligence in Education 2023; 1–16.
10. Deeley SJ. Using technology to facilitate effective assessment for learning and feedback in higher education. Assessment and Evaluation in Higher Education 2018; 43(3).
11. Dong J., Xie J., Su H., Fu G. Research on the construction of makerspaces in the colleges and Universities of Guangdong Province from the Perspective of Industry-Education Collaboration Atlantis Press 2022; 81–86.
12. Elliot AJ., McGregor HA. Test anxiety and the hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology 1999; 76(4): 628–644.
13. Gardner J., O’Leary M., Yuan L. Artificial intelligence in educational assessment: ‘Breakthrough? Or buncombe and ballyhoo?’ Journal of Computer Assisted Learning 2021; 37(5): 1207–1216.
14. Hooda M., Rana C., Dahiya O., Rizwan A., Hossain MS. Artificial ıntelligence for assessment and feedback to enhance student success in higher education. Mathematical Problems in Engineering 2022.
15. Hu X., Tan A., Gao Y. The Construction of the development mode of school-enterprise cooperation in higher vocational education with the aid of sensitive neural network. Wireless Communications and Mobile Computing 2023.
16. Lu YC., Xiao Y., Sears A., Jacko JA. A review and a framework of handheld computer adoption in healthcare. International Journal of Medical Informatics 2005; 74(5): 409–422.
17. Mondal H., Mondal S., Podder I. Using ChatGPT for writing articles for patients’ education for dermatological diseases: A pilot study. Indian Dermatology Online Journal 2023; 14(4): 482.
18. O’Neill T., Hartigan K., Spillane JP. Factors ınhibiting higher education ınstitutions from addressing ındustry driven change in ırish Construction Management Programs. International Journal of Construction Education and Research 2024; 20(1): 65–82.
19. Qadir J. Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. In 2023 IEEE Global Engineering Education Conference (EDUCON) 2023; 1–9. IEEE.
20. Rahaman MdS., Ahsan MMT., Anjum N., Terano HJR., Rahman MdM. From ChatGPT-3 to GPT-4: A Significant Advancement in AI-Driven NLP Tools. Journal of Engineering and Emerging Technologies 2023; 2(1): 1–11.
21. Saba TS., Sundus S. Revolutionizing healthcare with AI: The role of ChatGPT. Journal of University Medical and Dental College 2023; 14(2).
22. Sacks R., Pikas E. Building ınformation modeling education for construction engineering and management. I: Industry requirements, state of the art, and gap analysis. Journal of Construction Engineering and Management 2013; 139(11): 04013016.
23. Talan T., Kalinkara Y., Bilgileri M. Yükseköğrenimde yapay zekânın rolü: Anatomi dersi için ChatGPT değerlendirmesi The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course. International Journal of Management Information Systems and Computer Science 2023; 7(1): 33–40.
24. Vahedifard F., Haghighi AS., Dave T., Tolouei M., Zare FH. Practical use of ChatGPT in psychiatry for treatment plan and psychoeducation 2023.
25. Xu L., Sanders L., Li K., LChow JC. in press. Chatbot for health care and oncology applications using artificial ıntelligence and machine learning: Systematic Review. JMIR Cancer 2021; 7(4).
26. Yeadon W., Hardy T. The impact of AI in physics education: A comprehensive review from GCSE to university levels. Physics Education 2024; 59(2): 025010.
27. Zhang J., Xie H., Li H. Improvement of students problem-solving skills through project execution planning in civil engineering and construction management education. Engineering, Construction and Architectural Management 2019; 26(7).
28. Zhang R., Zou D. Types, purposes, and effectiveness of state-of-the-art technologies for second and foreign language learning. Computer Assisted Language Learning 2022; 35(4): 696–742.