GENERATIVE ARTIFICIAL INTELLIGENCE MODEL FINE-TUNED WITH CULTURAL AND TOURISM DATA FROM THE TURKIC STATES

Öz

Generative Artificial Intelligence (GENAI), after GPT 3.0, has become a useful tool. By training and feeding Machine Learning (ML) algorithms with many parameters, it has become possible to obtain very fast and highly accurate results. Thus, GENAIs have become a personalized tool in tourism and travel who want to travel to the Turkic States. The model was trained and finetuned with context-related (culture and tourism) data specific to the region. The model’s success was measured using the metrics of precision, sensitivity, and F1 score used in measuring ML algorithms. The developed application is accessible from Android devices. According to these calculations, the performance of the model for simple queries was measured as 93% (F1 Score). As a personalized GenAI model and application, the study is supposed to support visitors who visit the Turkish World Geography. By the designed GENAI model, the study will contribute to the theory and practice by demonstrating the usability of digital technologies in tourism, for the Turkic State Region.

Anahtar Kelimeler

• Generative Artificial Intelligence
• Training Artificial Intelligence
• Fine Tuning
• Turkic State Chat Bot
• Tourism

TÜRK DEVLETLERİNİN KÜLTÜREL VE TURİZM VERİLERİYLE İNCE AYARI YAPILMIŞ ÜRETKEN YAPAY ZEKA MODELİ

Öz

Üretken Yapay Zeka (ÜYZ) GPT 3.0 ve sonrası herkes tarafından kullanılabilen ve tercih edilen bir araç haline dönüşmüştür. Makine Öğrenmesi (MÖ) algoritmalarının çok fazla parametreyle eğitilmesi ve beslenmesi sonucu yapılan sorgulara çok hızlı ve doğruluk oranı yüksek sonuçlar üretilmesi mümkün hale gelmiştir. Bu nedenle ÜYZ’ler turizm ve seyahatte kişiselleştirilmiş bir araç haline dönüşmüştür. Bu çalışmada geliştirilen ÜYZ modeli, eğitilerek Türk Dünyası Coğrafyası’nı gezmek isteyen bireylerin kullanımına uygun bir araç ve aplikasyon haline getirilmiştir. Geliştirilen aplikasyon Android cihazlardan erişilebilir durumdadır. Model, bölgeye özgü kültür ve turizmle ilgili internet verileriyle eğitilmiş ve ince ayarı yapılmıştır. Model başarısının ölçümünde ise MÖ modellerinin ölçümünde kullanılan, kesinlik, duyarlılık ve F1 skoru metriklerinden yararlanılmıştır. Bu hesaplamalara göre basit sorgulamalar için modelin başarı oranı % 93 (F1 Skoru) olarak ölçülmüştür. Kişiselleştirilmiş bir ÜYZ modeli ve uygulaması olması yönüyle, çalışmanın pratikte Türk Dünyası Coğrafyası’nı ziyaret edecek kişilere destek olacağı düşünülmektedir. Geliştirilen ÜYZ uygulamasının turizmde dijital teknolojilerin kullanılabilirliğini göstermesi adına, alana katkı sağlayacağı düşünülmektedir.

Anahtar Kelimeler

• Üretken Yapay Zeka
• Yapay Zeka Eğitimi
• İnce Ayar
• Türk Dünyası Sohbet Botu
• Turizm

Kaynakça

1. Adam, Martin, Michael Wessel, and Alexander Benlian, “AI-based chatbots in customer service and their effects on user compliance,” Electronic Markets Vol. 31, No. 2 (2021): 427-445.
2. Akpur, Akın, “Seyahat Danışmanı Olarak Chatgpt’nin Yeteneklerini Keşfetmek: Turizm Pazarlamasında Üretken Yapay Zeka Üzerine Bir Araştırma”, International Journal of Contemporary Tourism Research, Vol. 7, No.2, 2023, pp. 93-105. https://doi.org/10.30625/ijctr.1325428.
3. Ali, Faizan. “Let the devil speak for itself: Should ChatGPT be allowed or banned in hospitality and tourism schools?” Journal of Global Hospitality and Tourism, Vol. 2, No.1, 2023, pp. 1-6. http://doi.org/10.5038/2771-5957.2.1.1016.
4. Alkaissi, Hussam and McFarlane, Samy I. “Artificial hallucinations in ChatGPT: implications in scientific writing”, Cureus, Vol. 15, No. 2, 2023, pp. 1-4. Pubmed, http://doi.org/0.7759/ cureus.35179.
5. Alston, E. (2023). ChatGPT vs. GPT-3 and GPT-4: What’s the difference? Retrieved February 21, 2024 from https://zapier.com/blog/chatgpt-vs-gpt/
6. Baghırov, Orkhan. (2022). “The organization of Turkic States’ economic potential and cooperation prospects among its members”, PERCEPTIONS: Journal of International Affairs, Vol.27, No:1, 2022, pp.53-73.
7. Bayuk, Mahmut Nedim and Demir, Beyza Nur. ”Endüstri 4.0 Kapsaminda Yapay Zekâ ve Pazarlamanin Geleceği”, International Journal of Social, Humanities and Administrative Sciences, Vol. 5, No.19, 2019, pp. 781-799. http://dx.doi.org/10.31589/JOSHAS.163
8. “Booking.com Enhances Travel Planning with New AI-Powered Features for Easier, Smarter Decisions”. Booking 30 October 2024, https://news.booking.com/bookingcom-enhances-travel- planning-with-new-ai-powered-features--for-easier-smarter-decisions/

9. Bosse, D., Thompson, S., & Ekman, P. (2023). In consilium apparatus: Artificial intelligence, stakeholder reciprocity, and firm performance. Journal of Business Research, Vol. 155, No: A, 2023, pp.113402. https://doi.org/10.1016/j.jbusres.2022.113402
10. Carvalho, Inês. and Ivanov, Stabislav. “ChatGPT for tourism: applications, benefits and risks”, Tourism Review, Vol. 79, No. 2, 2023, pp. 290-303. https://doi.org/10.1108/TR-02-2023-0088
11. ”ChatGPT & Generative AI in Hospitality and Travel Industry”. 18 February 2024 https://aisera. com/blog/chatgpt-hospitality/#chatgpt-usecases-hospitality
12. Chatterjee, S., Ghosh, S. K., Chaudhuri, R., & Nguyen, B.” Are CRM systems ready for AI integration? A conceptual framework of organizational readiness for effective AI-CRM integration” The Bottom Line, Vol. 32 No.2, 2019, pp. 144-157.
13. Christensen, Jeff, Jared M. Hansen, and Paul Wilson. “Understanding the role and impact of Generative Artificial Intelligence (AI) hallucination within consumers’ tourism decision-making processes”, Current Issues in Tourism Vol. 28 No.4, 2025: 545-560.
14. Crolic, C., Thomaz, F., Hadi, R., & Stephen, A. T. “Blame the bot: Anthropomorphism and anger in customer–chatbot interactions”, Journal of Marketing, Vol. 86 No.1, 2022, pp. 132-148, https://doi.org/10.1177/002224292110456
15. Cumhurbaşkanlığı İletişim Başkanlığı. “2021-2025 Yapay Zeka Stratejisi” , https://cbddo.gov.tr/ SharedFolderServer/Genel/File/TR-UlusalYZStratejisi2021-2025.pdf, Access: 01.08.2024
16. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019, June),” Bert: Pre-training of deep bidirectional transformers for language understanding”, In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers) (pp. 4171-4186).
17. Dogru, Tarık et al. “Generative artificial intelligence in the hospitality and tourism industry: Developing a framework for future research”. Journal of Hospitality & Tourism Research, 10963480231188663. https://doi.org/10.1177/10963480231188663
18. Ercan, Fatih.” Turizm pazarlamasında yapay zekâ teknolojilerinin kullanımı ve uygulama örnekleri”. Ankara Hacı Bayram Veli Üniversitesi Turizm Fakültesi Dergisi, vol.23, no.2, 2020, pp. 394-410. http:/doi.org/ 10.34189/tfd.23.02.009
19. Florido-Benítez, Lázaro. “Generative artificial intelligence: a proactive and creative tool to achieve hyper-segmentation and hyper-personalization in the tourism industry.” International Journal of Tourism Cities (2024), https://doi.org/10.1108/IJTC-05-2024-0111
20. “Gemini: A Family of Highly Capable Multimodal Models.” https://storage.googleapis.com/deepmind- media/gemini/gemini_1_report.pdf, Access: 20 February 2024,
21. Gozalo-Brizuela, Roberto., & Garrido-Merch´an, Eduardo. C. “ChatGPT is not all you need. A State of the Art Review of large Generative AI models.” arXiv preprint arXiv:2301.04655. 2023, https://doi.org/10.48550/arXiv.2301.04655
22. Goodhue, D. L., & Thompson, R. L. “Task-technology fit and individual performance”, JSTOR, MIS Quarterly, Vol.19, No.2, 1995, pp.213-236. https://doi.org/10.2307/249689
23. “Put Your Trip on Autopilot: Expedia Group Introduces New Innovations at EXPLORE to Take the Stress out of Travel and Enhance Partner Experience” Expedia. https://www.expedia.com/ newsroom/spring-product-release-2024/ Acess:14 May 2024.
24. Grundner, Lukas and Neuhofer, Barbara. “The bright and dark sides of artificial intelligence: A futures perspective on tourist destination experiences”. Journal of Destination Marketing & Management, Vol.19, 2021, pp. 1-12. https://doi.org/10.1016/j.jdmm.2020.100511
25. Gupta, Ruchi et al. “Adoption and impacts of generative artificial intelligence: Theoretical underpinnings and research agenda”, International Journal of Information Management Data Insights, Vol. 4, No.1, 2024, pp. 1-15, https://doi.org/10.1016/j.jjimei.2024.100232
26. “Henn na Hotel”.Henn na. . https://group.hennnahotel.com/01.07.2024. Access: 01.07.2024 Hodges, Andrew. (2013). “Alan Turing.” Stanford Encyclopedia of Philosophy, https://plato.stanford. edu/Entries/turing/ Access: 23.02.2024
27. “The 2023 Traveler Emerging Trends that are Innovating the Travel Experience Hilton: A Report from Hilton. Hilton, https://view.ceros.com/hilton/hilton-2023-trends-report/p/1 Access: 01.09.2024
28. Huang, Ming-Hui and Rust, Roland T. “A strategic framework for artificial intelligence in marketing”. Journal of the Academy of Marketing Science, Vol. 49, 2021, pp.30-50. https://doi. org/10.1007/s11747-020-00749-9
29. Huang, Kai et al. “Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation”. 2023, arXiv preprint arXiv:2309.13192. https://doi.org/10.48550/arXiv.2309.13192
30. Kalyan, Katikapalli Subramanyam. “A survey of GPT-3 family large language models including ChatGPT and GPT-4.” Natural Language Processing Journal, Vol. 6,2024, pp. 100048. https:// doi.org/10.1016/j.nlp.2023.100048
31. Kim, Daniel. H., & MacKinnon, T. “Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks.” Clinical Radiology, Vol.73, No.5, 2018, pp. 439- 445. https://doi.org/10.1016/j.crad.2017.11.015
32. Kocaman, Ömer. “Adjusting to the ‘New Normal’ of Post COVID-19: The Role of Organization of Turkic States in Multilateral Cooperation”. PERCEPTIONS: Journal of International Affairs, Vol. 26, No. 2, 2022, pp. 189-15.
33. Koçak, Muhammet. “Potential of Organization of Turkic States in the International System.” Insight Türkiye, Vol.25, No:4, 2023, pp. 115-138.
34. Koubaa, Anis. “GPT-4 vs. GPT-3.5: A concise showdown”. Prerpints.org, 2023. https://doi. org/10.20944/preprints202303.0422.v1
35. Köseoğlu, Özer and Demirci, Yılmaz.” Akıll Şehirler ve Yerel Sorunların Çözümünde Yenilikçi Teknolojilerin Kullanımı.” Uluslararası Politik Araştırmalar Dergisi, Vol. 4, No. 2, 2018, pp. 40-57. https://doi.org/10.25272/j.2149-8539.2018.4.2.03
36. Kraišniković, Ceca et al. “Fine-tuning language model embeddings to reveal domain knowledge: An explainable artificial intelligence perspective on medical decision making.” Engineering Applications of Artificial Intelligence, Vol. 139, No. b., 2025, pp. 1-15, https://doi.org/10.1016/j. engappai.2024.109561
37. Kühl, Niklas et al. “Supporting customer-oriented marketing with artificial intelligence: automatically quantifying customer needs from social media”, Electronic Markets, Vol. 30, No.2, 2020, pp. 351-367. https://doi.org/10.1007/s12525-019-00351-0
38. Lapata, Mirella. “What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata. [Video]. Youtube”. https://www.youtube.com/watch?v=_6R7Ym6Vy_I. Access: 01.01.2024
39. Lawton, George. “ChatGPT vs. GPT: How are they different?” 12, , https://www.techtarget.com/ searchenterpriseai/feature/ChatGPT-vs-GPT-How-are-they-different, Acess: 12.02.2023
40. Lee, Peter et al., “Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine”, New England Journal of Medicine, Vol. 388, No.13, pp.1233-1239. https://doi.org/10.1056/NEJMsr2214184
41. Li, Yue et al. “Fine‐tuning of artificial intelligence managers’ logic in a supply chain with competing retailers”, Decision Sciences, Vol.55, 2024, pp. 639-652, https://doi.org/10.1111/deci.12657
42. Lin, John.C., et al. “Comparison of GPT-3.5, GPT-4, and human user performance on a practice ophthalmology written examination”, Eye Vol. 37, 2023, pp. 3694–3695 https://doi. org/10.1038/s41433-023-02564-2
43. Liu, Zhuang et al. “Dropout reduces underfitting.” International Conference on Machine Learning, 2023, pp. 22233-22248. PMLR.
44. Łukasik-Stachowiak, Katarzyna. “Artificial Intelligence (AI) in CRM–possibility of effective integration, opportunities and threats. Scientific Papers of Silesian University of Technology.” Organization & Management Vol. 175.2023, http://dx.doi.org/10.29119/1641-3466.2023.175.18
45. Maleki, Negar et al. “AI hallucinations: a misnomer worth clarifying”, IEEE Conference on Artificial Intelligence (CAI), 2024, pp. 133-138. Https://doi.org/10.1109/CAI59869.2024.00033
46. Meyer, Annika et al. “Comparison of the performance of GPT-3.5 and GPT-4 with that of medical students on the written German medical licensing examination: observational study.” JMIR Medical Education, Vol.10, 2024, pp. e50965. http://doi.org/10.2196/50965
47. Mustofaev, Murodjon. “The organization of Turkic States: a new approach to global and regional challenges”, Perceptions: Journal of International Affairs, Vol. 27, No:1, 2022, pp.105-120.
48. Nyaaba, Matthew. “Comparing Human and AI’s (GPT-4 and Gemini) Understanding of the Nature of Science”, 2023, SSRN 4661602. http://dx.doi.org/10.2139/ssrn.4661602
49. Özer, Çağlar “The Organization of Turkic States-From Past to Present”, Balkan and Near Eastern Journal of Social Sciences, Vol.9, 2023, pp.150-161.
50. Poncelas, Alberto and Way, Andy. “Selecting artificially-generated sentences for fine-tuning neural machine translation”, 2019, arXiv preprint arXiv:1909.12016.
51. Saputra, Fachri Eka et al. “Anthropomorphism-based artificial intelligence (AI) robots typology in hospitality and tourism”, Journal of Hospitality and Tourism Technology, Vol. 15 No. 5, 2024, pp. 790-807. https://doi.org/10.1108/JHTT-03-2024-0171
52. Scheschenja, Michael et al. “Feasibility of GPT-3 and GPT-4 for in-depth patient education prior to interventional radiological procedures: a comparative analysis”, Cardiovascular and Interventional Radiology, Vol.47, No.2, 2024, pp. 245-250. https://doi.org/10.1007/s00270-023- 03563-2 Schmelzer, Ron and Walch, Kathleen. “The Seven Patterns of AI. Simplify your AI projects by understanding the seven patterns of AI application, which apply to all AI use cases.”=. https:// www.pmi.org/blog/seven-patterns-of-ai. Access: 7.11.2024
53. Schuetzler, Ryan. M., et al., “The impact of chatbot conversational skill on engagement and perceived humanness”, Journal of Management Information Systems, Vol. 37, No. 3, 2020, pp. 875-900 https://doi.org/10.1080/07421222.2020.1790204.
54. Singh, Shashi Kant et al ”GPT & Google Bard AI: A Review” Proceedings of the International Conference on IoT, Communication and Automation Technology (ICICAT), 1-6, 2023, http://doi.org/10.1109/ICICAT57735.2023.10263706
55. Sonnenburg, Anna et al, “Artificial intelligence-based data extraction for next generation risk assessment: Is fine-tuning of a large language model worth the effort?” Toxicology, Vol. 508, 2024, pp.1-8. https://doi.org/10.1016/j.tox.2024.153933
56. Thirunavukarasu, Arun. James., et al. “Large language models in medicine.” Nature Medicine, Vol.29, No.8, 2023, pp.1930-1940. https://doi.org/10.1038/s41591-023-02448-8
57. “This Luxury Hotel Introduces New AI Robotic Housekeeper” Global Traveler 28 June 2023, https://www.globaltravelerusa.com/this-luxury-hotel-introduces-new-ai-robotic-housekeeper/ Access: 02.06.2024.
58. Trichopoulos, Georgios et al, “Crafting a Museum Guide Using ChatGPT4”, Big Data and Cognitive Computing, Vol. 7, No.3, 2023, pp. 148-164. https://doi.org/10.3390/bdcc7030148
59. Tussyadiah, Iis. “A review of research into automation in tourism: Launching the Annals of Tourism Research Curated Collection on Artificial Intelligence and Robotics in Tourism”, Annals of Tourism Research, Vol. 81, 2020, pp.102883- 102897, https://doi.org/10.1016/j.annals. 2020.102883
60. Upwork. “Generative AI vs. ChatGPT: How They Interrelate” , https://www.upwork.com/resources/ generative-ai-vs-chatgpt#:~:text=ChatGPT%20is%20a%20form%20of,potential%20 of%20generative%20AI%20tools. Access: 9.02.2024
61. Wooldridge, M. “What’s the future for generative AI?” - The Turing Lectures with Mike Wooldridge [Video]. Youtube. , https://www.youtube.com/watch?v=b76gsOSkHB4. Access: 6.12.2023
62. Wong, IpKin Anthony et al. “Autonomous travel decision-making: An early glimpse into ChatGPT and generative AI.” Journal of Hospitality and Tourism Management, Vol.56, 2023, pp.253- 263. https://doi.org/10.1016/j.jhtm.2023.06.022
63. Yılmaz, Muhammed Enes. “Gerçek insan etkileşimlerini taklit eden yapay zekâ kasiyer Moskova Metrosu’nda bilet satışı yapmaya başladı.” Haber Global https://haberglobal.com.tr/dunya/yapay- zeka-kasiyerler-bilet-satisina-basladi-377932, Access: 14 September 2024
64. Ying, Xue. “An overview of overfitting and its solutions.” In Journal of physics: Conference series, Vol. 1168, 2019, p. 022022. IOP Publishing. http://doi.org/10.1088/1742-6596/1168/2/022022.
65. Yüce, Kemal. “Chatbot’lar ve Yapay Zeka: Aralarındaki Fark Nedir?” , https://www.incehesap.com/ blog/chatbot-yapay-zeka-aralarindaki-fark Access: 05.01.2024