Artificial Intelligence and Disinformation: Analysis of Global Disinformation Campaigns in Light of the OpenAI Report

Abstract

This study aims to understand the new threats emerging in the digital environment by examining the use of artificial intelligence (AI) technologies in disinformation campaigns. The rapid development of AI and its extensive data processing capabilities have increased the speed and impact of disinformation, rendering societal structures and democratic processes more vulnerable. The study investigates disinformation strategies within the context of AI, exploring its role in manipulating information and constructing false realities. Theoretically, the contribution of AI to the disinformation environment is discussed, and disinformation strategies in the literature are elaborated. Methodologically, the study employs literature review and electronic material analysis methods. Specifically, an OpenAI report serves as a case study, examining AI-supported disinformation campaigns conducted by countries such as Russia, China, Iran, and Israel. The findings highlight the adverse effects of these countries' disinformation campaigns on global security and diplomacy. This study contributes to understanding the societal impacts of disinformation and aims to support efforts to develop solutions to this issue.

Keywords

• Artificial Intelligence
• Disinformation
• Digital Ecosystem
• OpenAI Report
• Disinformation Campaigns

Yapay Zekâ ve Dezenformasyon: OpenAI Raporu Doğrultusunda Küresel Dezenformasyon Kampanyalarının Analizi

Abstract

Bu çalışma, yapay zekâ teknolojilerinin dezenformasyon kampanyalarında kullanımını ele alarak dijital ortamda ortaya çıkan yeni tehditleri anlamayı amaçlamaktadır. Yapay zekânın hızlı gelişimi ve geniş çapta veri işleme kapasitesi, dezenformasyonun yayılma hızını ve etkisini artırarak toplumsal yapıları ve demokratik süreçleri savunmasız hâle getirmektedir. Çalışma, dezenformasyon stratejilerini yapay zekâ bağlamında inceleyerek, bilginin manipülasyonu ve sahte gerçekliklerin oluşturulmasındaki rolünü araştırmaktadır. Kuramsal olarak yapay zekânın dezenformasyon ortamına olan katkısı ele alınmış ve literatürdeki dezenformasyon stratejileri detaylandırılmıştır. Metodolojik olarak literatür taraması ve elektronik materyal inceleme yöntemleri kullanılmıştır. Bu çalışmada sistematik bir literatür taraması yapılmış ve OpenAI tarafından yayımlanan, yapay zekâ kullanılarak dezenformasyon faaliyetlerini ele alan dört ülkeye ait raporlar doküman analizi yöntemiyle incelenmiştir. Özellikle, OpenAI raporu üzerinden Rusya, Çin, İran ve İsrail gibi ülkelerin yürüttüğü yapay zekâ destekli dezenformasyon kampanyaları vaka çalışması olarak incelenmiştir. Bulgular, bu ülkelerin dezenformasyon kampanyalarının küresel güvenlik ve diplomasi üzerindeki olumsuz etkilerine işaret etmektedir. Çalışma, dezenformasyonun toplumsal etkilerini anlamaya ve bu soruna karşı çözüm geliştirme çabalarına katkı sunmayı hedeflemektedir.

Keywords

• Yapay Zekâ
• Dezenformasyon
• Dijital Ekosistem
• OPENAI Raporu
• Dezenformasyon Kampanyaları

References

1. Aboutayeb, Mostafa. 2023. “Démystification de la désinformation en ligne : Une approche analytique”. FRANCISOLA 8(2): 113-20. doi:10.17509/francisola.v8i2.63493.
2. Arce, Daniel. 2024. “Disinformation Strategies”. Defence and Peace Economics: 1-14. doi:10.1080/10242694.2024.2302236
3. Auezov, M., E.A. Nysanov, Zh.S. Kemelbekova, A.N. Zhidebayeva, A. Kuatbekov University of Peoples’ Friendship, S.E. Kozhabaev, M. Auezov South Kazakhstan University, A.U. Korokbaev, ve A. Kuatbekov University of Peoples’ Friendship. 2024. “Computer simulation and description of the phenomenon of the development of information technology using moore’s law”. Bulletin of the National Engineering Academy of the Republic of Kazakhstan 91(1): 93-102. doi:10.47533/2024.1606-146X.10.
4. Balcioğlu, Yavuz Selim, ve Bülent Dogan. 2023. “Dissecting Disinformation Dynamics: Insights from a Social Media Environment”. İletişim ve Diplomasi (11): 107-25. doi:10.54722/iletisimvediplomasi.1374744
5. Barman, Dipto, Ziyi Guo, ve Owen Conlan. 2024. “The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and Dissemination”. Machine Learning with Applications 16: 100545. doi:10.1016/j.mlwa.2024.100545.
6. Bontridder, Noémi, ve Yves Poullet. 2021. “The Role of Artificial Intelligence in Disinformation”. Data & Policy 3: e32. doi:10.1017/dap.2021.20.
7. Caled, Danielle, ve Mário J. Silva. 2022a. “Digital Media and Misinformation: An Outlook on Multidisciplinary Strategies against Manipulation”. Journal of Computational Social Science 5(1): 123-59. doi:10.1007/s42001-021-00118-8
8. Caled, Danielle, ve Mário J. Silva. 2022b. “Digital Media and Misinformation: An Outlook on Multidisciplinary Strategies against Manipulation”. Journal of Computational Social Science 5(1): 123-59. doi:10.1007/s42001- 021-00118-8.

9. Chambers, JK. 2010. “Bad’grammar and the Language Faculty”. University of Pennsylvania Working Papers in Linguistics 16(38): 19-25. https://core. ac.uk/download/pdf/76365019.pdf.
10. Chan, Jovy. 2024. “Online Astroturfing: A Problem beyond Disinformation”. Philosophy & Social Criticism 50(3): 507-28. doi:10.1177/01914537221108467
11. Chesney, Robert, ve Danielle Citron. 2018. “Deepfakes and the New Disinformation War The Coming Age of Post-Truth Geopolitics”. Foreign Affairs. https://www.foreignaffairs.com/articles/world/2018-12-11/deepfakes-and-new-disinformation-war
12. Cho, Charles H., Martin L. Martens, Hakkyun Kim, ve Michelle Rodrigue. 2011. “Astroturfing Global Warming: It Isn’t Always Greener on the Other Side of the Fence”. Journal of Business Ethics 104(4): 571-87. doi:10.1007/ s10551-011-0950-6.
13. Clos, Jeremie, Emma Mcclaughlin, Pepita Barnard, Tino Tom, ve Sudarshan Yajaman. 2023. “A Privacy-Preserving Observatory of Misinformation Using Linguistic Markers - A Work in Progress”. Içinde Proceedings of the First International Symposium on Trustworthy Autonomous Systems, Edinburgh United Kingdom: ACM, 1-4. doi:10.1145/3597512.3597530
14. Cybenko, Anne K., ve George Cybenko. 2018. “AI and Fake News”. IEEE Intelligent Systems 33(5): 1-5. doi:10.1109/MIS.2018.2877280.
15. Deschrijver, Cedric. 2024. “Assessing Potential Disinformation Campaigns in Anonymous Online Comments: Evaluating Available Textual Cues in Debates on the 2019 Hong Kong Protests”. Language & Communication 95: 31- 41. doi:10.1016/j.langcom.2024.01.002.
16. Dhamani, Numa, Paul Azunre, Jeffrey L. Gleason, Craig Corcoran, Garrett Honke, Steve Kramer, ve Jonathon Morgan. 2019. “Using Deep Networks and Transfer Learning to Address Disinformation”. http://arxiv.org/ abs/1905.10412 (Erişim Tarihi:15 Eylül 2024)
17. Dias, Emmanuelle, Letícia Lopes, ve Felipe Borges. 2024. “Estratégias de desinformação na produção de videoensaios”. Esferas (29). doi:10.31501/esf. v1i29.14892.
18. Dordevic, Miljan, Milan Milivojevic, ve Ana Gavrovska. 2019. “DeepFake Video Analysis using SIFT Features”. İçinde 2019 27th Telecommunications Forum (TELFOR), Belgrade, Serbia: IEEE, 1-4. doi:10.1109/TELFOR48224.2019.8971206
19. EEAS. 2024. Doppelganger Operation - EEAS Technical Report. https://euvsdisinfo.eu/uploads/2024/06/EEAS-TechnicalReport-DoppelgangerEE24_ June2024.pdf.
20. Fallis, Don. 2014. “A Functional Analysis of Disinformation”. Içinde iConference 2014
21. Ferrara, Emilio, Onur Varol, Clayton Davis, Filippo Menczer, ve Alessandro Flammini. 2016. “The Rise of Social Bots”. Communications of the ACM 59(7): 96-104. doi:10.1145/2818717 Proceedings, iSchools. doi:10.9776/14278.
22. Fraga-Lamas, Paula, ve Tiago M. Fernandez-Carames. 2020. “Fake News, Disinformation, and Deepfakes: Leveraging Distributed Ledger Technologies and Blockchain to Combat Digital Deception and Counterfeit Reality”. IT Professional 22(2): 53-59. doi:10.1109/MITP.2020.2977589
23. Francis, E. 2018. MisInfoWars: A Linguistic Analysis of Deceptive and Credible News. Simon Fraser University. https://books.google.com.tr/books?id=TMcGywEACAAJ.
24. François, Camille, ve Evelyn Douek. 2021. “The Accidental Origins, Underappreciated Limits, and Enduring Promises of Platform Transparency Reporting about Information Operations”. Journal of Online Trust and Safety 1(1). doi:10.54501/jots.v1i1.17.
25. Franklin, Margarita, Lindsay Hundley, Mike Torrey, David Agronovich, ve Mike Dvilyanski. 2024. Adversarial Threat Report. Meta. https://md.teyit.org/ file/meta-threat-report.pdf.
26. García Serrano, Jesús, Luis M. Romero-Rodríguez, ve Ángel Hernando Gómez. 2019. “Análisis del ‘clickbaiting’ en los titulares de la prensa española contemporánea / Estudio de caso: Diario ‘El País’ en Facebook”. Estudios sobre el Mensaje Periodístico 25(1): 197-212. doi:10.5209/ESMP.63724
27. Garg, Diya, ve Rupali Gill. 2024. “A Bibliometric Analysis of Deepfakes : Trends, Applications and Challenges”. ICST Transactions on Scalable Information Systems 11(6). doi:10.4108/eetsis.4883.
28. Giachanou, Anastasia, Xiuzhen Zhang, Alberto Barrón-Cedeño, Olessia Koltsova, ve Paolo Rosso. 2022. “Online Information Disorder: Fake News, Bots and Trolls”. International Journal of Data Science and Analytics 13(4): 265- 69. doi:10.1007/s41060-022-00325-0
29. Gül Ünlü, Derya, ve Zafer Küçükşabanoğlu. 2023. “Dezenformasyon ve Yapay Zekâ: Dezenformasyonla Mücadele Yollarına Yapay Zekâ Uzmanlarının Gözünden Bakmak”. İletişim ve Diplomasi (11): 83-106. doi:10.54722/iletisimvediplomasi.1375478.
30. Havlík, Martin. 2023. “Deepfake as an Advanced Manipulative Technique for Spreading Propaganda”. Vojenské rozhledy 32(1): 3-17. doi:10.3849/2336- 2995.32.2023.01.003-017
31. Hayden, Joseph R. 2024. A History of Disinformation in the U.S. 1. bs New York: Routledge. doi:10.4324/9781003331551.
32. Howard, P, ve S Bradshaw. 2018. “The global organization of social media disinformation campaigns”. Journal of International Affairs 71(1.5)
33. Innes, Martin. 2020. “Techniques of Disinformation: Constructing and Communicating ‘Soft Facts’ after Terrorism”. The British Journal of Sociology 71(2): 284-99. doi:10.1111/1468-4446.12735
34. Islas, Octavio, Fernando Gutiérrez, ve Amaia Arribas. 2024. “Artificial Intelligence, a Powerful Battering Ram in the Disinformation Industry”. New Explorations 4(1): 1111639ar. doi:10.7202/1111639ar
35. Jing, Junchang, Fei Li, Bin Song, Zhiyong Zhang, ve Kim-Kwang Raymond Choo. 2023. “Disinformation Propagation Trend Analysis and Identification Based on Social Situation Analytics and Multilevel Attention Network”. IEEE Transactions on Computational Social Systems 10(2): 507-22. doi:10.1109/TCSS.2022.3169132
36. Jingnan, Hou. 2024. “How Israel tried to use AI to covertly sway Americans about Gaza”. Wusf npr. https://www.wusf.org/2024-06-05/how-israel-tried-to-use-ai-to-covertly-sway-americans-about-gaza
37. Kandel, Nirmal. 2020. “Information Disorder Syndrome and Its Management”. Journal of Nepal Medical Association 58(224). doi:10.31729/jnma.4968.
38. Karinshak, Elise, ve Yan Jin. 2023. “AI-Driven Disinformation: A Framework for Organizational Preparation and Response”. Journal of Communication Management 27(4): 539-62. doi:10.1108/JCOM-09-2022-0113
39. Keller, Franziska B., David Schoch, Sebastian Stier, ve JungHwan Yang. 2020. “Political Astroturfing on Twitter: How to Coordinate a Disinformation Campaign”. Political Communication 37(2): 256-80. doi:10.1080/10584609.20 19.1661888.
40. Kıral, Bilgen. 2020. “Nitel bir veri analizi yöntemi olarak doküman analizi.” Siirt Üniversitesi Sosyal Bilimler Enstitüsü Dergisi (8(15)): 170-89
41. Kovic, Marko, Adrian Rauchfleisch, Marc Sele, ve Christian Caspar. 2018. “Digital astroturfing in politics: Definition, typology, and countermeasures”. Studies in Communication Sciences 18(1). doi:10.24434/j.scoms.2018.01.005
42. Kreps, Sarah E., Miles McCain, ve Miles Brundage. 2020. “All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media Misinformation”. SSRN Electronic Journal. doi:10.2139/ssrn.3525002.
43. Kumar, Akash, Arnav Bhavsar, ve Rajesh Verma. 2020. “Detecting Deepfakes with Metric Learning”. İçinde 2020 8th International Workshop on Biometrics and Forensics (IWBF), Porto, Portugal: IEEE, 1-6. doi:10.1109/ IWBF49977.2020.9107962.
44. Kumar, Rajeev, Suhel Ahmad Khan, Nawaf Alharbe, ve Raees Ahmad Khan. 2024. “Code of Silence: Cyber Security Strategies for Combating Deepfake Disinformation”. Computer Fraud & Security 2024(4): S1361- 3723(24)70013-X. doi:10.12968/S1361-3723(24)70013-X.
45. Lungarella, Max, Fumiya Iida, Josh C. Bongard, ve Rolf Pfeifer. 2007. “AI in the 21st Century – With Historical Reflections”. Içinde 50 Years of Artificial Intelligence, Lecture Notes in Computer Science, ed. Max Lungarella, Fumiya Iida, Josh Bongard, ve Rolf Pfeifer. Berlin, Heidelberg: Springer Berlin Heidelberg, 1-8. doi:10.1007/978-3-540-77296-5_1.
46. Maathuis, Clara, Frederick Janssens, ve Ebrahim Rahimi. 2024. “Design of a Disinformation Awareness Digital Game”. European Conference on Social Media 11(1): 127-36. doi:10.34190/ecsm.11.1.2053.
47. Mansfeld, J. 1978. “Zeno of Citium”. Mnemosyne 31(2): 134-78. doi:10.1163/156852578X00337.
48. Martin, L. John. 1982. “Disinformation: An Instrumentality in the Propaganda Arsenal”. Political Communication 2(1): 47-64. doi:10.1080/10584609.1982.9962747
49. McLoughlin, Killian L., ve William J. Brady. 2024. “Human-Algorithm Interactions Help Explain the Spread of Misinformation”. Current Opinion in Psychology 56: 101770. doi:10.1016/j.copsyc.2023.101770
50. Montasari, Reza. 2024. “The Dual Role of Artificial Intelligence in Online Disinformation: A Critical Analysis”. Içinde Cyberspace, Cyberterrorism and the International Security in the Fourth Industrial Revolution, Advanced Sciences and Technologies for Security Applications, Cham: Springer International Publishing, 229-40. doi:10.1007/978-3-031-50454-9_11.
51. Mosleh, Mohsen, Rocky Cole, ve David Gertler Rand. 2024. “Misinformation and harmful language are interconnected, rather than distinct, challenges”. doi:10.31234/osf.io/y5n4u.
52. Mueller, Robert S. 2019. “Report on the Investigation Into Russian Interference in the 2016 Presidential Election”. https://digital.library.unt.edu/ark:/67531/ metadc1933948/.
53. Na, David, Samuel Nathanson, Yungjun Yoo, Yinzhi Cao, ve Lanier Watkins. 2024. “Showcasing the Threat of Scalable Generative AI Disinformation through Social Media Simulation”. İçinde IEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Vancouver, BC, Canada: IEEE, 1-2. doi:10.1109/INFOCOMWKSHPS61880.2024.10620878.
54. Nefedova, Lilia, ve Maria Samkova*. 2019. “Detection Of Disinformation In A Media Text (Structural And Pragma-Linguistic Approaches)”. İçinde , 265-72. doi:10.15405/epsbs.2019.08.02.31
55. Nimmo, Ben. 2024. AI and Covert Influence Operations: Latest Trends. OpenAI: OpenAI. https://downloads.ctfassets.net/kftzwdyauwt9/5IMxzTmUclSOAcWUXbkVrK/3cfab518e6b10789ab8843bcca18b633/Threat_Intel_Report.pdf
56. Omoregie, Uyiosa. 2021. “The ‘Harm Principle’ and Information Disorder Online”. Academia Letters. doi:10.20935/AL3425.
57. OpenAI. 2024. “Disrupting deceptive uses of AI by covert influence operations”. https://openai.com/index/disrupting-deceptive-uses-of-ai/
58. Pennekamp, Jan, Martin Henze, Oliver Hohlfeld, ve Andriy Panchenko. 2019. “Hi Doppelgänger : Towards Detecting Manipulation in News Comments”. Içinde Companion Proceedings of The 2019 World Wide Web Conference, San Francisco USA: ACM, 197-205. doi:10.1145/3308560.3316496.
59. Quelle, Dorian, Calvin Cheng, Alexandre Bovet, ve Scott A. Hale. 2023. “Lost in Translation -- Multilingual Misinformation and its Evolution”. doi:10.48550/ ARXIV.2310.18089.
60. Renedo Farpón, Cristina, ve Francisco José García. 2023. “PRÓLOGO. Análisis de la desinformación: estrategias (en) de los desórdenes informativos”. Miguel Hernández Communication Journal 14: 15-18. doi:10.21134/mhjournal.v14i.1791.
61. Rossetti, Michael, ve Tauhid Zaman. 2023. “Bots, Disinformation, and the First Impeachment of U.S. President Donald Trump” ed. Alexandre Bovet. PLOS ONE 18(5): e0283971. doi:10.1371/journal.pone.0283971
62. Rubin, Victoria L. 2019. “Disinformation and Misinformation Triangle: A Conceptual Model for ‘Fake News’ Epidemic, Causal Factors and Interventions”. Journal of Documentation 75(5): 1013-34. doi:10.1108/JD-12-2018-0209
63. Ruffin, Margie, Haeseung Seo, Aiping Xiong, ve Gang Wang. 2024. “Does It Matter Who Said It? Exploring the Impact of Deepfake-Enabled Profiles on User Perception towards Disinformation”. Proceedings of the International AAAI Conference on Web and Social Media 18: 1328-41. doi:10.1609/icwsm.v18i1.31392
64. Shoaib, Mohamed R., Zefan Wang, Milad Taleby Ahvanooey, ve Jun Zhao. 2023. “Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Models”. doi:10.48550/ARXIV.2311.17394
65. Starbird, Kate, Renée DiResta, ve Matt DeButts. 2023. “Influence and Improvisation: Participatory Disinformation during the 2020 US Election”. Social Media + Society 9(2): 20563051231177943. doi:10.1177/20563051231177943.
66. Turğal, L., ve B.B. Küçükerdoğan. 2023. “Bir Dezenformasyon Aracı Olarak Yapay Zekâ: Bing Arama Motoru Örneğinde İklim Değişikliği Konulu Haber Fotoğraflarının İncelenmesi.” İletişim Ve Diplomasi (11): 57-82. doi:https://doi.org/10.54722/iletisimvediplomasi.1376404.
67. Ustinovich, Elena Stepanovna. 2024. “Generative artificial intelligence in the electoral processes of 2024 in the world: disinformation campaigns and online trolls”. Social’naja politika i social’noe partnerstvo (Social Policy and Social Partnership) (3): 197-204. doi:10.33920/pol-01-2403-03.
68. V. Baravkar, Prof. Pooja, Namita Survase, Sakshi Shrimandale, ve Gaurav Hande. 2023. “Survey On ‘Deepvision’s Human Eye Blink Pattern Analysis for Deepfake Detection’”. INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT 07(10): 1-11. doi:10.55041/IJSREM26418
69. Vosoughi, Soroush, Deb Roy, ve Sinan Aral. 2018. “The Spread of True and False News Online”. Science 359(6380): 1146-51. doi:10.1126/science.aap9559
70. Wardle, Claire, ve Hossein Derakhshan. 2017. INFORMATION DISORDER: Toward an interdisciplinary framework for research and policy making. Published by the Council of Europe. Council of Europe report. https://rm.coe.int/information-disorder-toward-an-interdisciplinary-framework-for-researc/168076277c.
71. Warin, Thierry. 2024. Disinformation in the Digital Age: Impacts on Democracy and Strategies for Mitigation. CIRANO. doi:10.54932/GQWB1497.
72. Weber, Derek, ve Frank Neumann. 2021. “Amplifying Influence through Coordinated Behaviour in Social Networks”. Social Network Analysis and Mining 11(1): 111. doi:10.1007/s13278-021-00815-2.
73. Woolley, Samuel C. 2022. “Digital Propaganda: The Power of Influencers”. Journal of Democracy 33(3): 115-29. doi:10.1353/jod.2022.0027.
74. Wu, Liang, ve Huan Liu. 2017. “Detecting Crowdturfing in Social Media”. Içinde Encyclopedia of Social Network Analysis and Mining, ed. Reda Alhajj ve Jon Rokne. New York, NY: Springer New York, 1-9. doi:10.1007/978- 1-4614-7163-9_110196-1
75. Yang, Angela. 2024. “Meta and OpenAI say they disrupted influence operations linked to Israeli company”. https://www.nbcnews.com/tech/security/ meta-openai-say-disrupted-israeli-companys-influence-campaign-rcna154774.
76. Yıldız, A. 2022. “Bir araştırma metodolojisi olarak sistematik literatür taramasına genel bakış”. Anadolu Üniversitesi Sosyal Bilimler Dergisi (22(Özel Sayı 2)): 367-86
77. Zannettou, Savvas, Tristan Caulfield, William Setzer, Michael Sirivianos, Gianluca Stringhini, ve Jeremy Blackburn. 2019. “Who Let The Trolls Out?: Towards Understanding State-Sponsored Trolls”. İçinde Proceedings of the 10th ACM Conference on Web Science, Boston Massachusetts USA: ACM, 353-62. doi:10.1145/3292522.3326016.
78. Zerback, Thomas, ve Florian Töpfl. 2022. “Forged Examples as Disinformation: The Biasing Effects of Political Astroturfing Comments on Public Opinion Perceptions and How to Prevent Them”. Political Psychology 43(3): 399-418. doi:10.1111/pops.12767.