Research Article

The performance of artificial intelligence in the exams of tourist guidance

Volume: 9 Number: 3 December 31, 2024
EN

The performance of artificial intelligence in the exams of tourist guidance

Abstract

The aim of this study is to evaluate the efficiency of ChatGPT versions 3.5 and 4 for training tourist guides. The study followed a systematic approach by conducting assessments on undergraduate students from three institutions who are enrolled in tourist guide education programs and both ChatGPT versions. Competent academicians assessed a succession of questions in the form of open-ended and multiple-choice questions. The mean scores obtained on the multiple-choice test for ChatGPT-4 were better than those of both ChatGPT-3.5 and college students, thereby indicating that ChatGPT-4 has greatly improved. Nevertheless, when responding to open-ended queries, individuals with real-life experience as tour guides gave much more inclusive as well as convincing answers compared to ChatGPT-4. This underscores the importance of hands-on experiences in training tour guides, where AI technology is currently weak. This study contributes to better comprehension regarding the role played by artificial intelligence (AI) in education with reference to the tourism industry specifically. While at the same time emphasizing how critical human expertise is needed during practical learning sessions, this implies that AI has potential for disseminating theoretical knowledge. The results suggest that AI is a beneficial supplementary aid in educational environments, rather than a replacement for human-centered instructional approaches.


Keywords

Artificial intelligence, Large language models (LLMs), Tourism education, Tourist guidance, Exam

Ethical Statement

This article was approved by the ethics committee of Harran University. Number of ethics committee approval report: No. 2023/151.

References

  1. Abduljabbar, R., Dia, H., Liyanage, S., & Bagloee, S. A. (2019). Applications of artificial intelligence in transport: an overview. Sustainability, 11(1), 189. https://doi.org/10.3390/su11010189
  2. Agarwal, S., Agarwal, B., & Gupta, R. (2022). Chatbots and virtual assistants: A bibliometric analysis. Library Hi Tech, 40(4), 1013–1030. https://doi.org/10.1108/LHT-09-2021-0330
  3. Alawida, M., Mejri, S., Mehmood, A., Chikhaoui, B., & Isaac Abiodun, O. (2023). A comprehensive study of chatgpt: Advancements, limitations, and ethical considerations in natural language processing and cybersecurity. Information, 14(8), 462. https://doi.org/10.3390/info14080462
  4. Alazaizeh, M. M., Jamaliah, M. M., Mgonja, J. T., & Ababneh, A. (2019). Tour guide performance and sustainable visitor behavior at cultural heritage sites. Journal of Sustainable Tourism, 27(11), 1708–1724. https://doi.org/10.1080/09669582.2019.1658766
  5. Ali, K., Barhom, N., Marino, F. T., & Duggal, M. (2023). The thrills and chills of ChatGPT: Implications for assessments in undergraduate dental education [Preprint]. MEDICINE & PHARMACOLOGY. https://doi.org/10.20944/preprints202302.0513.v1
  6. Athavale, A., Baier, J., Ross, E., & Fukaya, E. (2023). The potential of chatbots in chronic venous disease patient management. JVS-Vascular Insights, 100019. https://doi.org/10.1016/j.jvsvi.2023.100019
  7. Atlas, S. (2023). ChatGPT for higher education and professional development: A guide to conversational AI. College of Business Faculty Publications. https://digitalcommons.uri.edu/cba_facpubs/548
  8. Aydın, Ö., & Karaarslan, E. (2023). Is ChatGPT leading generative AI? What is beyond expectations? SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4341500
  9. Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745
  10. Bommarito II, M., & Katz, D. M. (2022). GPT Takes the Bar Exam. arXiv. http://arxiv.org/abs/2212.14402
APA
Ülkü, A. (2024). The performance of artificial intelligence in the exams of tourist guidance. Journal of Multidisciplinary Academic Tourism, 9(3), 231-243. https://doi.org/10.31822/jomat.2024-9-3-231
AMA
1.Ülkü A. The performance of artificial intelligence in the exams of tourist guidance. Jomat. 2024;9(3):231-243. doi:10.31822/jomat.2024-9-3-231
Chicago
Ülkü, Abdullah. 2024. “The Performance of Artificial Intelligence in the Exams of Tourist Guidance”. Journal of Multidisciplinary Academic Tourism 9 (3): 231-43. https://doi.org/10.31822/jomat.2024-9-3-231.
EndNote
Ülkü A (December 1, 2024) The performance of artificial intelligence in the exams of tourist guidance. Journal of Multidisciplinary Academic Tourism 9 3 231–243.
IEEE
[1]A. Ülkü, “The performance of artificial intelligence in the exams of tourist guidance”, Jomat, vol. 9, no. 3, pp. 231–243, Dec. 2024, doi: 10.31822/jomat.2024-9-3-231.
ISNAD
Ülkü, Abdullah. “The Performance of Artificial Intelligence in the Exams of Tourist Guidance”. Journal of Multidisciplinary Academic Tourism 9/3 (December 1, 2024): 231-243. https://doi.org/10.31822/jomat.2024-9-3-231.
JAMA
1.Ülkü A. The performance of artificial intelligence in the exams of tourist guidance. Jomat. 2024;9:231–243.
MLA
Ülkü, Abdullah. “The Performance of Artificial Intelligence in the Exams of Tourist Guidance”. Journal of Multidisciplinary Academic Tourism, vol. 9, no. 3, Dec. 2024, pp. 231-43, doi:10.31822/jomat.2024-9-3-231.
Vancouver
1.Abdullah Ülkü. The performance of artificial intelligence in the exams of tourist guidance. Jomat. 2024 Dec. 1;9(3):231-43. doi:10.31822/jomat.2024-9-3-231