Perception of ChatGPT in Turkey: Sentiment analysis with Bert model

Öz

The study aims to analyze users' feelings about this technology, their emotional tendencies, and the concepts associated with these trends, based on tweets shared during the first quarter of ChatGPT's release. Since sentiment analysis studies on ChatGPT generally focus on English, this research will make a local contribution to the field by focusing on Turkish. Between 1.12.2022 and 1.03.2023, 15,556 non-retweet Turkish Twitter posts containing the "Chatgpt" hashtag were drawn using the R language using data mining technique. Data simplification, analysis, and visualization processes of Twitter shares, which are divided into three separate periods, were made with Python programming language. According to the results of the research, ChatGPT was met by users with more positive emotions rather than negative ones. In the first month, it is seen to be more paired with negative emotions compared to other months. However, behind this is often the risk of "being unemployed" or "disinformation". Negative emotional tendencies in the second month, application failures, and different answers to the same question; positive emotional tendencies are related to Microsoft's investment. When the emotion scores of the posts were examined, it was observed that the positive tendencies were higher with a small margin, but the scores decreased in both emotion categories as the months progressed. Based on the findings of this research, future comprehensive studies on ChatGPT that include user content with opinions in languages other than English will provide more diverse insights into the adoption of AI in general and ChatGPT in particular.

Anahtar Kelimeler

• ChatGPT
• Sentiment Analysis
• Twitter
• Python
• R Language

Türkiye’de ChatGPT algısı: Bert modeli ile duygu analizi

Öz

Bu çalışma, ChatGPT'nin kullanıma sunulduğu ilk üç aylık döneminde paylaşılan tweet'lerle kullanıcıların bu teknolojiye ilişkin duygularının analizini, duygusal eğilimlerini ve bu eğilimlerle ilişkili kavramlarını incelemektedir. 01.12.2022-01.03.2023 tarihleri arasında "chatgpt" konu etiketini içeren 15.556 adet retweet içermeyen Türkçe Twitter gönderisi R dili ile veri madenciliği tekniği kullanılarak çekilmiştir. Üç ayrı döneme ayrılan Twitter paylaşımlarının veri sadeleştirme, analiz ve görselleştirme işlemleri Python programlama dili ile yapılmıştır. Araştırma sonuçlarına göre ChatGPT kullanıcılar tarafından daha çok negatif yerine pozitif duygularla karşılanmıştır. İlk ayında diğer aylara kıyasla negatif duygularla daha çok eşleştirilmiş görülmektedir. Ancak bunun arkasında genellikle "işsiz kalmak" veya "dezenformasyon" riski bulunmaktadır. İkinci ayında negatif duygusal eğilimler uygulama aksaklıkları ve aynı soruya verilen farklı yanıtlar; pozitif duygusal eğilimler ise Microsoft'un yatırım yapmasıyla ilişkilidir. Üçüncü ayında ise arama motorları ve Çin ekseninde kelime dağılımı görülmektedir. Bu ay içerisinde kullanıcılar Çin erişim engeli negatif duygularla ancak birçok teknoloji şirketinin ChatGPT'ye entegre olması ya da benzer bir teknoloji üretmesine ilişkin duyurular pozitif duygularla algılamıştır. Paylaşımların duygu skorlarına bakıldığında ise çok küçük farkla pozitif eğilimlerin daha yüksek olduğu ancak aylar ilerledikçe her iki duygu kategorisinde skorun düştüğü gözlemlenmiştir. Bu araştırma bulgularına dayanarak gelecekte ChatGPT'ye yönelik İngilizce dışındaki dillerde görüşler içeren kullanıcı içeriğini içeren kapsamlı çalışmalar yapılması, genelde yapay zekanın özelde ChatGPT'nin toplum tarafından benimsenmesine ilişkin daha çeşitli içgörülerin yakalanmasını sağlayacaktır.

Anahtar Kelimeler

• ChatGPT
• Duygu Analizi
• Twitter
• Pyhton
• R Dili

Kaynakça

1. Abdullah, M., Madain, A. ve Jararweh, Y. (2022). ChatGPT: Fundamentals, applications and social impacts. 2022 Ninth International Conference on Social Networks Analysis, Management and Security (SNAMS), IEEE, 18 Ocak 2024 tarihinde https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10062688&casa_token=2knaLzDo4aIAAAAA:HpWPOeyBZ5xkV-SZlc3ZSHqYILs5sWGwMZbYmFh9XlRN60bM7dKAc_VWYtsHfKmo1eg5J-ZpVKM&tag=1 adresinden erişildi.
2. Adalı, E. (2012). Doğal dil işleme. Türkiye Bilişim Vakfı Bilgisayar Bilimleri ve Mühendisliği Dergisi, 5(2), 4 Ocak 2023 tarihinde https://dergipark.org.tr/en/pub/tbbmd/issue/22245/238797 adresinden erişildi.
3. Adeshola, I. ve Adepoju, A. P. (2023). The opportunities and challenges of ChatGPT in education. Interactive Learning Environments, https://doi.org/10.1080/10494820.2023.2253858
4. Agarwal, A., Xie, B., Vovsha, I., Rambow, O. ve Passonneau, R. J. (2011). Sentiment analysis of Twitter data. Proceedings of the workshop on language in social media (LSM 2011) (30-38). 5 Ocak 2024 tarihinde https://aclanthology.org/W11-0705.pdf adresinden erişildi.
5. Ağduk, S., Çelik, F. Y. ve Aydemir, E. (2024). TurkishBERT ile Youtube yemek tarifi videolarındaki yorumların duygusal tonalitenin incelenmesi. Anatolia Science and Technology Journal, 1(1), 13-24.
6. Akdeniz, F. N. ve Cebeci, H. İ. (2021). Belediye hizmetlerin değerlendirilmesinde duygu analizi yaklaşımı: Sakarya ili örneği. Zeki Sistemler Teori ve Uygulamaları Dergisi, 4(2), 127-135.
7. AlAfnan, M. A., Dishari, S., Jovic, M. ve Lomidze, K. (2023). Chatgpt as an educational tool: Opportunities, challenges, and recommendations for communication, business writing, and composition courses. Journal of Artificial Intelligence and Technology, 3(2), 60-68.
8. Alsaeedi, A. ve Khan, M. Z. (2019). A study on sentiment analysis techniques of Twitter data. International Journal of Advanced Computer Science and Applications, 10(2), 361-374.

9. Aslan, S. (2023). Doğal Dil İşleme Teknikleri Kullanarak E-Ticaret Kullanıcı İncelemelerinde Özellik Tabanlı Duygu Analizi. Fırat Üniversitesi Mühendislik Bilimleri Dergisi, 35(2), 875-882.
10. Aydın, Ö. ve Karaarslan, E. (2022). OpenAI ChatGPT generated literature review: Digital twin in healthcare. Ö. Aydın (Ed.), Emerging Computer Technologies 2 (22-31). İzmir Akademi Derneği, http://dx.doi.org/10.2139/ssrn.4308687
11. Azaira, A. (2022). ChatGPT usage and limitations. 2 Ocak 2023 tarihinde https://scholar.googleusercontent.com/scholar?q=cache:rcgzP7VbeNQJ:scholar.google.com/+chatgpt&hl=tr&as_sdt=0,5 adresinden erişildi.
12. Bahrainian, S. A. ve Dengel, A. (2013). Sentiment analysis and summarization of Twitter data. 2013 IEEE 16th International Conference on Computational Science and Engineering (227-234). IEEE, 5 Ocak 2024 tarihinde https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6755222&casa_token=pzmOViz-HRwAAAAA:y8CsGEESxvCY_h5J8kVrjnstiYKxSTMFm1a_xsspePyiEXM2IXe2jssFthHWOp83aSieYvFd70Q&tag=1 adresinden erişildi.
13. Borwankar, S., Khern-am-nuai, W. ve Kannan, K. (2023). Unraveling the impact: An Empirical Investigation of ChatGPT's Exclusion from Stack Overflow. SSRN: https://ssrn.com/abstract=4481959
14. Brandl, R. ve Ellis, C. (2023, 28 02). ChatGPT Statistics 2023: All the latest statistics about OpenAI’s chatbot. 6 Ocak 2023 tarihinde https://www.tooltester.com/en/blog/chatgpt-statistics/ adresinden erişildi.
15. Cumhuriyet. (2022, 23 12). Google, ChatGPT için 'Kırmızı Kod' yayınladı! Cumhuriyet, 6 Ocak 2023 tarihinde https://www.cumhuriyet.com.tr/bilim-teknoloji/google-chatgpt-icin-kirmizi-kod-yayinladi-2014554 adresinden erişildi.
16. Cotton, D. R., Cotton, P. A. ve Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1-12. https://doi.org/10.1080/14703297.2023.2190148
17. Dodig-Crnkovic, G. (2023). How GPT Realizes Leibniz’s Dream and Passes the Turing Test without Being Conscious. Computer Sciences ve Mathematics Forum, 8(66), https://doi.org/10.3390/cmsf2023008066
18. Dodd, H. (2023). Sentiment Analysis of tweets about ChatGPT. 3 Ocak 2024 tarihinde https://ir.lib.uwo.ca/cgi/viewcontent.cgi?article=1010&context=fims_evolvingtech_finalproj_summer2023 adresinden erişildi.
19. Duarte, F. (2024). Number of ChatGPT users (2024), Exploding Topiscs, 18 Ocak 2024 tarihinde https://explodingtopics.com/blog/chatgpt-users# adresinden erişildi.
20. de Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E. ve Rizzo, C. (2023). ChatGPT and the rise of large language models: The new AI-driven infodemic threat in public health. Frontiers in Public Health, 11, 1166120, 1-8. https://doi.org/10.3389/fpubh.2023.1166120
21. Erdinç, U. ve Bursa, N. (2021). Covid-19 Pandemi Sürecinde Twitter Yorumları ile Altcoın Kripto Para Piyasası Arasındaki Nedenselliğin Duygu Analizi ile İncelenmesi: Ripple Örneği. Journal of Management and Economics Research, 19(4), 362-381.
22. Erz, H. (2022). I get your excitement about ChatGPT, but…. 2 Ocak 2023 tarihinde https://www.hendrik-erz.de/post/i-get-your-excitement-about-chatgpt-but adresinden erişildi.
23. Fimoza, D., Amalia, A. ve Harumy, T. H. F. (2021). Sentiment analysis for movie review in Bahasa Indonesia using BERT. 2021 International Conference on Data Science, Artificial Intelligence, and Business Analytics (DATABIA) (27-34). IEEE, 14 Ekim 2024 tarihinde https://ieeexplore.ieee.org/abstract/document/9650096/?casa_token=2SATK7DL4XQAAAAA:CKI6Mm7Bb0Iq4AR0RZsl0RYMQ3VOj7Q4MrI6rLA25TH6ySlfIRqpJlNPmVnmmPYIx6_SzoTApQ adresinden erişildi.
24. Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K. ve Chen, L. (2023). Generative AI and ChatGPT: Applications, challenges, and AI-human collaboration. Journal of Information Technology Case and Application Research, 25(3), 277-304.
25. Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y. ve Pearson, A. T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. bioRxi, https://doi.org/10.1101/2022.12.23.521610
26. Giachanou, A. ve Crestani, F. (2016). Like it or not: A survey of twitter sentiment analysis methods. ACM Computing Surveys (CSUR), 49(2), 1-41.
27. Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A. ve Chartash, D. (2022). How Well Does ChatGPT Do When Taking the Medical Licensing Exams? The Implications of Large Language Models for Medical Education and Knowledge Assessment. medRxiv, https://doi.org/10.1101/2022.12.23.22283901
28. Go, A., Huang, L. ve Bhayani, R. (2009). Twitter sentiment analysis. Entropy, 17, 19 Ocak 2024 tarihinde https://www-nlp.stanford.edu/courses/cs224n/2009/fp/3.pdf adresinden erişildi.
29. Gobira, M., Nakayama, L. F., Moreira, R., Andrade, E., Regatieri, C. V. S. ve Belfort Jr, R. (2023). Performance of ChatGPT-4 in answering questions from the Brazilian national examination for medical degree revalidation. Revista da Associação Médica Brasileira, 69(10), https://doi.org/10.1590/1806-9282.20230848
30. Görmez, Y., Arslan, H. ve Atak, B. (2024). Türkçe Metinlerde Duygu Analizi: Derin Öğrenme Yaklaşımlarının ve Ön İşlem Süreçlerinin Model Performansına Etkisi. Fırat Üniversitesi Mühendislik Bilimleri Dergisi, 36(1), 509-520.
31. Hadi, M. U., al tashi, Qureshi, R., Shah, A., Irfan, M., Zafar, A., Shaikh, M. B., ... ve Mirjalili, S. (2023). A survey on large language models: Applications, challenges, limitations, and practical usage. 18 Ocak 2024 tarihinde https://d197for5662m48.cloudfront.net/documents/publicationstatus/170687/preprint_pdf/afaf5dabd52e8f44288e8e800a54f43d.pdf adresinden erişildi.
32. Haber Global. (2023, 27 02). ChatGPT'yi siyaset yapmakla suçlayan Çin, popüler yapay zekaya erişimi engelledi. HaberGlobal, 1 Mart 2023 https://haberglobal.com.tr/teknoloji/chatgptyi-siyaset-yapmakla-suclayan-cin-populer-yapay-zekaya-erisimi-engelledi-234644 adresinden erişildi.
33. Haque, M. U., Dharmadasa, I., Sworna, Z. T., Rajapakse, R. N. ve Ahmad, H. (2022). I think this is the most disruptive technology: Exploring sentiments of ChatGPT early adopters using Twitter data. arXiv, 2212.05856, https://doi.org/10.48550/arXiv.2212.05856
34. Hussein, D. M. E. D. M. (2018). A survey on sentiment analysis challenges. Journal of King Saud University-Engineering Sciences, 30(4), 330-338, https://doi.org/10.1016/j.jksues.2016.04.002
35. Jiao, W., Wang, W., Huang, J. T., Wang, X. ve Tu, Z. P. (2023). Is ChatGPT a good translator? Yes with GPT-4 as the engine. 2 Ocak 2024 tarihinde https://arxiv.org/pdf/2301.08745.pdf adresinden erişildi.
36. Kandıran, E., Gumus, B. ve Özer, M. A. (2022). Covid-19 pandemi sürecinde uzaktan eğitimin twitter yansımalarının duygu analizi. International Journal of Social Sciences and Education Research, 8(3), 228-242.
37. Kechaou, Z., Ammar, M. B. ve Alimi, A. M. (2013). A multi-agent based system for sentiment analysis of user-generated content. International Journal on Artificial Intelligence Tools, 22(02), 1350004-28.
38. Keskinkılıç, M. ve Öz, A. E. (2023). Twitter'da metin madenciliği ve duygu analizi ile uzaktan eğitim memnuniyetinin incelenmesi. Turkish Studies-Economics, Finance, Politics, 18(3), 941-960.
39. Khan, S. (2022). Business Intelligence Aspect for Emotions and Sentiments Analysis. 2022 First International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT) (1-5). IEEE.
40. Kharde, V. ve Sonawane, P. (2016). Sentiment analysis of twitter data: A survey of techniques. arXiv preprint arXiv:1601.06971, https://doi.org/10.48550/arXiv.1601.06971
41. Knight, W. (2022). ChatGPT’s most charming trick is also its biggest flaw. 2 Ocak 2023 tarihinde https://www.wired.com/story/openai-chatgpts-most-charming-trick-hides-its-biggest-flaw/ adresinden erişildi.
42. Koonchanok, R., Pan, Y. ve Jang, H. (2024). Public Attitudes toward Chatgpt on Twitter: Sentiments, Topics, and Occupations. Social Network Analysis and Mining, 14(106), https://doi.org/10.1007/s13278-024-01260-7
43. Korkmaz, A., Aktürk, C. ve Talan, T. (2023). Analyzing the user's sentiments of ChatGPT using twitter data. Iraqi Journal For Computer Science and Mathematics, 4(2), 202-214.
44. Kung, T. H., Cheatham, M., Medinilla, A., Sillos, C., De Leon, L., Elepano, C. ve Tseng, V. (2022). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. medRxiv.
45. Küsmüş, A. (2024). COVID-19 salgını sürecinde uzaktan eğitime yönelik paylaşılan Türkçe Twitter mesajlarının duygu analizi. Mustafa Kemal Üniversitesi Eğitim Fakültesi Dergisi, 8(13), 16-29.
46. Lai, P. (2010). Extracting strong sentiment trends from Twitter. Nlpstanfordedu, 18 Ocak 2024 tarihinde https://nlp.stanford.edu/courses/cs224n/2011/reports/patlai.pdf adresinden erişildi.
47. Lai, U. H., Wu, K. S., Hsu, T. Y. ve Kan, J. K. C. (2023). Evaluating the performance of ChatGPT-4 on the United Kingdom Medical Licensing Assessment. Frontiers in Medicine, 10, https://doi.org/10.3389/fmed.2023.1240915
48. Li, J. ve Hovy, E. (2017). Reflections on sentiment/opinion analysis. Erik Cambria, Dipankar Das, Sivaji Bandyopadhyay ve Antonio Feraco (Ed.). A practical guide to sentiment analysis içinde (ss. 41-59). Cham, Switzerland: Springer.
49. Lian, Y., Tang, H., Xiang, M. ve Dong, X. (2023). Public attitudes and sentiments toward ChatGPT in China: A text mining analysis based on social media. Technology in Society, 76, https://doi.org/10.1016/j.techsoc.2023.102442
50. Lima, A. C. E., de Castro, L. N. ve Corchado, J. M. (2015). A polarity analysis framework for Twitter messages. Applied Mathematics and Computation, 270, 756-767.
51. Lin, H. Y. ve Moh, T. S. (2021). Sentiment analysis on COVID tweets using COVID-Twitter-BERT with auxiliary sentence approach. Proceedings of the 2021 ACM Southeast Conference (234-238), 12 Ekim 204 tarihinde https://dl.acm.org/doi/abs/10.1145/3409334.3452074 adresinden erişildi.
52. Liu, B. (2017). Many facets of sentiment analysis. Erik Cambria, Dipankar Das, Sivaji Bandyopadhyay ve Antonio Feraco (Ed.). A practical guide to sentiment analysis içinde (ss. 11-39), Cham, Switzerland: Springer.
53. Liu, B. (2012). Sentiment analysis and opinion mining. 7 Ocak 2024 tarihinde https://www.cs.uic.edu/~liub/FBS/liub-SA-and-OM-book.pdf adresinden erişildi.
54. Liu, B. (2010). Sentiment analysis and subjectivity. Handbook of natural language processing, 2(2010), 5 Ocak 2024 tarihinde https://www.cs.uic.edu/~liub/FBS/NLP-handbook-sentiment-analysis.pdf adresinden erişildi.
55. Lock, S. (2022, 05 12). What is AI chatbot phenomenon ChatGPT and could it replace humans? The Guardian, 2 Ocak 2023 tarihinde https://www.theguardian.com/technology/2022/dec/05/what-is-ai-chatbot-phenomenon-chatgpt-and-could-it-replace-humans adresinden erişildi.
56. Li, S. (2023). Exploring the clinical capabilities and limitations of ChatGPT: A cautionary tale for medical applications. International Journal of Surgery, 109(9), 2865-2867.
57. Livberber, T. ve Ayvaz, S. (2023). The impact of Artificial Intelligence in academia: Views of Turkish academics on ChatGPT. Heliyon, 9(9), https://doi.org/10.1016/j.heliyon.2023.e19688
58. Macdonald, C., Adeloye, D., Sheikh, A. ve Rudan, I. (2023). Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. Journal of Global Health, 13, https://doi.org/10.7189/jogh.13.01003
59. Martínez-Cámara, E., Martín-Valdivia, M. T., Urena-López, L. A. ve Montejo-Ráez, A. R. (2014). Sentiment analysis in Twitter. Natural language engineering, 20(1), 1-28.
60. Masarifoglu, M., Tigrak, U., Hakyemez, S., Gul, G., Bozan, E., Buyuklu, A. H. ve Özgür, A. (2021, June). Sentiment analysis of customer comments in banking using bert-based approaches. 2021 29th Signal Processing and Communications Applications Conference (SIU) (1-4). IEEE, 15 Ekim 2024 tarihinde https://ieeexplore.ieee.org/abstract/document/9477890 adresinden erişildi.
61. Medhat, W., Hassan, A. ve Korashy, H. (2014). Sentiment analysis algorithms and applications: A survey. Ain Shams engineering journal, 5(4), 1093-1113.
62. Meyer, J. G., Urbanowicz, R. J., Martin, P. C., O’Connor, K., Li, R., Peng, P. C., ... ve Moore, J. H. (2023). ChatGPT and large language models in academia: opportunities and challenges. BioData Mining, 16(20), 1-11. https://doi.org/10.1186/s13040-023-00339-9
63. Mijwil, M. M., Hiran, K. K., Doshi, R., Dadhich, M., Al-Mistarehi, A. H. ve Bala, I. (2023). ChatGPT and the future of academic integrity in the artificial intelligence era: A new frontier. Al-Salam Journal for Engineering and Technology, 2(2), 116-127.
64. Mok, A. (2022, 12 21). Google's management has reportedly issued a 'code red' amid the rising popularity of the ChatGPT AI. 6 Ocak 2023 tarihinde https://www.businessinsider.com/google-management-issues-code-red-over-chatgpt-report-2022-12 adresinden erişildi.
65. Mujahid, M., Kanwal, K., Rustam, F., Aljedaani, W. ve Ashraf, I. (2023). Arabic ChatGPT Tweets Classification using RoBERTa and BERT Ensemble Model. ACM Transactions on Asian and Low-Resource Language Information Processing, 22(8), 1-23.
66. Nature Machine Intelligence. (2022). Much to discuss in AI ethics. Nat Mach Intell, 4, 1055-1056. 4 Ocak 2023 tarihinde https://www.nature.com/articles/s42256-022-00598-x adresinden erişildi.
67. Noever, D. ve Ciolino, M. (2022). The turing deception. arXiv(2212.06721), https://arxiv.org/pdf/2212.06721.pdf 6.1.2024, https://doi.org/10.48550/arXiv.2212.06721
68. OpenAI. (2023, 01 02). https://openai.com/blog/chatgpt/ adresinden erişildi.
69. Pak, A. ve Paroubek, P. (2010). Twitter as a corpus for sentiment analysis and opinion mining. LREc, 10(2010), 1320-1326.
70. Peng, J., Fung, J. S., Murtaza, M., Rahman, A., Walia, P., Obande, D. ve Verma, A. R. (2023). A sentiment analysis of the Black Lives Matter movement using Twitter. STEM Fellowship Journal, 8(1), 56-66.
71. Polat, H. ve Ağca, Y. (2022). Trıpadvısor Kullanıcılarının Türkçe ve İngilizce Yorumları Kapsamında Duygu Analizi Yöntemlerinin Karşılaştırmalı Analizi. Abant Sosyal Bilimler Dergisi, 22(2), 901-916.
72. Poola, I. ve Božid, V. (2023). Guiding AI with human intuition for solving mathematical problems in Chat GPT. International Journal of Engineering ve Scientific Research, 11(07), 31-40.
73. Pota, M. Ventura, M., Catelli, R. ve Esposito, M. (2020). An effective BERT-based pipeline for Twitter sentiment analysis: A case study in Italian. Sensors, 21, 133, https://doi.org/10.3390/s21010133
74. Qadir, J. (2023). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. In 2023 IEEE Global Engineering Education Conference (EDUCON) IEEE.2 Ocak 2024 tarihinde https://d197for5662m48.cloudfront.net/documents/publicationstatus/168447/preprint_pdf/8955c7fb22e77b037240a9902d05c1c1.pdf adresinden erişildi.
75. Rambocas, M. ve Gama, J. (2013). Marketing research: The role of sentiment analysis (No. 489). Universidade do Porto, Faculdade de Economia do Porto, 5 Ocak 2024 tarihinde https://www.researchgate.net/publication/301549590_Marketing_research_The_role_of_sentiment_analysis adresinden erişildi.
76. Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
77. Renuka, O. ve Radhakrishnan, N. (2024). BERT for Twitter sentiment analysis: Achieving high accuracy and balanced performance. Journal of Trends in Computer Science and Smart Technology, 6(1), 37-50. Rogers, E. M. (2010). Diffusion of innovations. Simon and Schuster.
78. Rosenblatt, K. (2023, 06 01). ChatGPT banned from New York City public schools’ devices and networks. 6 Ocak 2023 tarihinde https://www.nbcnews.com/tech/tech-news/new-york-city-public-schools-ban-chatgpt-devices-networks-rcna64446 adresinden erişildi.
79. Roumeliotis, K. I. ve Tselikas, N. D. (2023). ChatGPT and Open-AI Models: A Preliminary Review. Future Internet, 15(6), 192, https://doi.org/10.3390/fi15060192
80. Ruby, D. (2022, 29 12). ChatGPT statistics for 2023: Comprehensive facts and data. 3 Ocak 2023 tarihinde https://www.demandsage.com/chatgpt-statistics/ adresinden erişildi.
81. Sahayak, V., Shete, V. ve Pathan, A. (2015). Sentiment analysis on twitter data. International Journal of Innovative Research in Advanced Engineering (IJIRAE), 2(1), 178-183.
82. Sebastian, T. M. (2012). Sentiment Analysis for Twitter (Master of Technology Computer Technology and Application Delhi Technological University, Delhi, 5 Ocak 2024 tarihinde http://www.dspace.dtu.ac.in:8080/jspui/bitstream/repository/14122/1/thesis1.pdf adresinden erişildi.
83. Shankland, S. (2022). Why everyone's obsessed with ChatGPT, a mind-blowing AI chatbot. 2 Ocak 2023 tarihinde https://www.cnet.com/tech/computing/why-everyones-obsessed-with-chatgpt-a-mind-blowing-ai-chatbot/ adresinden erişildi.
84. Singh, M., Jakhar, A. K. ve Pandey, S. (2021). Sentiment analysis on the impact of coronavirus in social life using the BERT model. Social Network Analysis and Mining, 11(33), https://doi.org/10.1007/s13278-021-00737-z
85. Stolkel-Walker, C. (2022). AI bot ChatGPT writes smart essays - should professors worry? Nature. https://doi.org/10.1038/d41586-022-04397-7
86. Strzelecki, A. (2024). Is ChatGPT-like technology going to replace commercial search engines?. Library Hi Tech News, 41(6), 19-22, https://doi.org/10.1108/LHTN-02-2024-0026
87. Su, Y. ve Kabala, Z. J. (2023). Public Perception of ChatGPT and Transfer Learning for Tweets Sentiment Analysis Using Wolfram Mathematica. Data, 8(180), 1-27, https://doi.org/10.3390/data8120180
88. Sudheesh, R., Mujahid, M., Rustam, F., Shafique, R., Chunduri, V., Villar, M. G., Ballester, J. B. ... ve Ashraf, I. (2023). Analyzing Sentiments Regarding ChatGPT Using Novel BERT: A Machine Learning Approach. Information, 14(474), https://doi.org/10.3390/info14090474
89. Susnjak, T. (2022). ChatGPT: The end of online exam integrity? 2 Ocak 2023 tarihinde https://arxiv.org/pdf/2212.09292.pdf adresinden erişildi.
90. Şeker, Ş. E. (2013, 02 04). Turing testi. 2 Ocak 2023 tarihinde https://bilgisayarkavramlari.com/2013/04/02/turing-testi/ adresinden erişildi.
91. Taboada, M. (2016). Sentiment analysis: An overview from linguistics. Annual Review of Linguistics, 2, 325-347. Taecharungroj, V. (2023). "What Can ChatGPT Do?" Analyzing Early Reactions to the Innovative AI Chatbot on Twitter. Big Data and Cognitive Computing, 7(35), https://doi.org/10.3390/bdcc7010035.
92. Turing M. A. (1950). Compuing machinery and intelligence. Mind, 236, 433- 460.
93. Xia, R., Xu, F., Zong, C., Li, Q., Qi, Y. ve Li, T. (2015). Dual sentiment analysis: Considering two sides of one review. IEEE transactions on knowledge and data engineering, 27(8), 2120-2133.
94. Verma, P. ve Lerman, R. (2022, 06 12). What is ChatGPT, the viral social media AI? 3 Ocak 2023 tarihinde https://www.washingtonpost.com/technology/2022/12/06/what-is-chatgpt-ai/ adresinden erişildi.
95. Vinco. (2022, 23 12). Discover the power and potential ChatGPT: The revolutionary chatbot that can carry on natural conversations with users. 3 Ocak 2023 tarihinde https://vinco.no/vinco-insight/discover-the-power-and-potential-of-chatgpt/ adresinden erişildi.
96. Wahbeh, A., Al-Ramahi, M., El-Gayar, O., Elnoshokaty, A. ve Nasralah, T. (2023, 10-11 December). Perception of bias in ChatGPT: Analysis of social media data. 2023 IEEE Global Conference on Artificial Intelligence and Internet of Things (GCAIoT) (34-39). IEEE, 9 Ekim 2024 tarihinde https://ieeexplore.ieee.org/document/10385099/ adresinden erişildi.
97. Wenzlaff, K. ve Spaeth, S. (2022). Smarter than Humans? Validating how OpenAI’s ChatGPT Model Explains Crowdfunding, Alternative Finance and Community Finance. 2 Ocak 2023 tarihinde https://ssrn.com/abstract=4302443. http://dx.doi.org/10.2139/ssrn.4302443
98. Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q. L. ve Tang, Y. (2023). A brief overview of ChatGPT: The history, status quo and potential future development. IEEE/CAA Journal of Automatica Sinica, 10(5), 1122-1136.
99. Yanko, A. (2022, 12 09). ChatGPT explodes on social media: what do people say? 3 Ocak 2023 tarihinde https://youscan.io/blog/chatgpt-explodes-on-social-media/ adresinden erişildi.
100. Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A. ve Testrow, C. (2022). The death of the short-form physics essay in the coming AI revolution. 4 Ocak 2023 tarihinde https://arxiv.org/pdf/2212.11661.pdf, adresinden erişildi. https://doi.org/10.1088/1361-6552/acc5cf
101. Yıldız, E. (2023). Sosyal medyada kriz yönetimine yönelik bir erken uyarı ve müdahale sistemi modeli. [Doktora tezi]. Marmara Üniversitesi.
102. Yılmaz, F. (2024). COVID-19 döneminde Twitter ile hisse senedi fiyatları arasındaki ilişkinin incelenmesi. Dokuz Eylül Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 26(2), 507-525.
103. Yildirim, S. (2020a). bert-base-turkish-sentiment-cased. 4 Ocak 2023 tarihinde https://huggingface.co/savasy/bert-base-turkish-sentiment-cased adresinden erişildi.
104. Yildirim, S. (2020b). Comparing deep neural networks to traditional models for sentiment analysis in turkish language. Deep learning-based approaches for sentiment analysis, 311-319.
105. Zhai, X. (2022). ChatGPT user experience: Implications for education. 2 Ocak 2023 tarihinde https://www.researchgate.net/profile/Xiaoming-Zhai/publication/366463233_ChatGPT_User_Experience_Implications_for_Education/links/63a2817aca6a9d254f8de010/ChatGPT-User-Experience-Implications-for-Education.pdf adresinden erişildi.