Text-as-Data in International Relations: Current Debates over Text Analysis in International Relations Studies

Year 2025, Volume: 34 Issue: 2, 152 - 166, 09.10.2025

Melike Ayşe Kocacık Şenol

https://doi.org/10.26650/siyasal.2025.34.1615063

Abstract

This review explores recent advancements in the study of international relations by focusing on text as a data source. Once a primary resource, texts have regained prominence with the rise of computational tools, offering new analysis opportunities. This review highlights the importance of communication, newspapers, speeches, and even social media in understanding human behavior and interactions among states. These textual sources not only provide insights into leaders’ reputation, resolve, and psychological traits but also contribute to detecting policy agendas and studying diplomatic outcomes. Improvements in methods such as big data analysis and machine learning have transformed how scholars build and analyze observational data in international relations. By revisiting key developments and applications, this review provides an overview of how texts are being used across various fields, including gathering event data, understanding foreign-policy agendas, particularly in international organizations, and detecting leader signals through platforms like Twitter. This assessment also addresses the growing significance of integrating these novel methods into future research and highlights the potential of text-based studies to shape the future of the discipline, offering scholars improved tools for analyzing complex global interactions and uncovering patterns in international relations.

Keywords

Text-as-data , International relations , Event data , NLP , Computational social science

References

• ALLen, S. H., & Vincent, T. (2011). Bombing to bargain? The air war for Kosovo. Foreign Policy Analysis, 7(1), 1-26. google scholar
• Azar, E. (1980). The conflict and peace data bank (COPDAB) project. Journal of Conflict Resolution, 24(1), 143-152. google scholar
• Baturo, A., Dasandi, N., & MikhayLov, S. J. (2017). Understanding state preferences with text as data: Introducing the UN GeneraL Debate corpus. Research & Politics, 4(2), 2053168017712821. google scholar
• BLankenship, B. (2020). Promises under pressure: statements of reassurance in US alliances. International Studles Quarterly, 64(4), 1017-1030. https://doi.org/l0.1093/isq/sqaa071 google scholar
• Bond, D., Jenkins, J. C., TayLor, C. L., & Schock, K. (1997). Mapping mass poLitical conflict and civiL society: Issues and prospects for the automated deveLopment of event data. Journal of Conflict Resolution, 41(4), 553-579. google scholar
• CLark, D. H., Fordham, B. O., & Nordstrom, T. (2016). PoLiticaL party and presidential decisions to use force: ExpLaining a puzzLing nonfinding. Presidential Studies Quarterly, 46(4), 791-807. google scholar
• Chhabra, R. (2020). Twitter dipLomacy: A brief anaLysis. Observer Research Foundation-ORF. Issue Brief, 335(1), 1-12. google scholar
• Chiba, D., & GLeditsch, K. S. (2017). The shape of things to come? Expanding the inequality and grievance model for civil war forecasts with event data. Journal of Peace Research, 54(2), 275-297. google scholar
• Collins, S. D., DeWitt, J. R., & LeFebvre, R. K. (2019). Hashtag diplomacy: twitter as a tool for engaging in public diplomacy and promoting US foreign policy. Place branding and public diplomacy, 15, 78-96. google scholar
• CoLLins, S., & DeWitt, J. (2023). Words Matter: Presidents Obama and Trump, Twitter, and US Soft Power. World Affairs, 186(3), 530-571. google scholar
• Çiçek, A. E. (2024). NucLear Powerplay: Traditional and Emerging State Dynamics in the United Nations General Assembly (1990-2017). Siyasal: Journal of Political Sciences, 33(1), 19-33. google scholar
• Çuhadar, Ç. E., Kaarbo, J., Kesgin, B., & Özkeçeci-Taner, B. (2021). Turkish Leaders and their foreign policy decision-making style: a comparative and multi-method perspective. Turkish Studies, 22(1), 1-27. google scholar
• Davis, C. L., Fuchs, A., & Johnson, K. (2019). State controL and the effects of foreign reLations on biLateral trade. Journal of Conflict Resolution, 63(2), 405-438. google scholar
• Drummond, J. (2009). Supreme command: Nine criticaL WorLd War II decisions by Winston Churchill. California State University, Dominguez Hills. google scholar
• Eckhard, S., Patz, R., SchönfeLd, M., & van Meegdenburg, H. (2023). InternationaL bureaucrats in the UN Security Council debates: A speaker-topic network analysis. Journal of European public policy, 30(2), 214-233. google scholar
• Erişen, E. (2012). An introduction to political psychoLogy for international relations scholars. Perceptions: Journal of International Affairs, 17(3), 9-28. google scholar
• Fearon, J. D. (1994). Domestic political audiences and the escaLation of international disputes. American political science review, 577-592. google scholar
• Fearon, J. D. (1995). RationaList explanations for war. International organization, 49(3), 379-414. google scholar
• Gerner, D. J., Schrodt, P. A., Yilmaz, O., & Abu-Jabr, R. (2002). Conflict and mediation event observations (CAMEO): A new event data framework for the analysis of foreign poLicy interactions. International Studies Association, New OrLeans. google scholar
• GoLdstein, J. S. (1992). A conflict-cooperation scaLe for WEIS events data. Journal of Conflict Resolution, 36(2), 369-385. google scholar
• Grimmer, J., Roberts, M. E., & Stewart, B. M. (2022). Text as data: A new framework for machine Learning and the social sciences. Princeton University Press. google scholar
• Grimmer, J., & Stewart, B. M. (2013). Text as data: The promise and pitfalls of automatic content analysis methods for poLitical texts. Political analysis, 21(3), 267-297. google scholar
• Hanania, R. (2021). The Humanitarian Turn at the UNSC: Explaining the development of international norms through machine learning aLgorithms. Journal of Peace Research, 58(4), 655-670. google scholar
• Hudson, V. M., & Vore, C. S. (1995). Foreign poLicy anaLysis yesterday, today, and tomorrow. Mershon International Studies Review, 39, 209-238. google scholar
• Jacobs, T., & TschötscheL, R. (2019). Topic modeLs meet discourse anaLysis: A quantitative tooL for a quaLitative approach. International Journal of Social Research Methodology, 22(5), 469-485. https://doi.org/l0.1080/l3645579.2019.1576317 google scholar
• Hanania, R. (2021). The Humanitarian Turn at the UNSC: ExpLaining the deveLopment of international norms through machine Learning algorithms. Journal of Peace Research, 58(4), 655-670. google scholar
• HatipoğLu, E., Gökçe, O. Z., Arın, İ., & Saygın, Y. (2018). Automated Text AnaLysis and International Relations: The Introduction and Appli-cation of a Novel Technique for Twitter. Ali Azimuth: A Journal of Foreign Policy and Peace. https://doi.org/10.20991/aLLazimuth. 476852. google scholar
• Hegre, H., Metternich, N. W., Nygârd, H. M., & Wucherpfennig, J. (2017). Introduction: Forecasting in peace research. Journal of Peace Research, 54(2), 113-124. google scholar
• Hermann, M. G. (2005). Assessing Leadership style: Trait anaLysis. The psychological assessment of political leaders, 7(2), 178-212. google scholar
• Kaarbo, J. (2015). A foreign policy analysis perspective on the domestic politics turn in IR theory. International Studies Review, 17(2), 189-216. google scholar
• Kesgin, B. (2020). Turkey’s Erdoğan: Leadership styLe and foreign poLicy audiences. Turkish Studies, 21(1), 56-82. google scholar
• King, G. (1989). Event count models for internationaL relations: GeneraLizations and applications. International Studies Quarterly, 33(2), 123-147. google scholar
• King, G., & Lowe, W. (2003). An automated information extraction tooL for international conflict data with performance as good as human coders: A rare events evaluation design. International Organization, 57(3), 617-642. google scholar
• Kocacık ŞenoL, M. A. (2025). Mapping resoLve in crisis bargaining through Leader public statements: an examination of the United States’ statements about Bosnia and Kosovo. European Security, 34(1), 107-126. google scholar
• Levyatan, Y. (2009). Harold D. Lasswell's analysis of Hitler's speeches. Media History, 15(1), 55-69. google scholar
• Lupton, D. L. (2018). Reexamining Reputation for ResoLve: Leaders, States, and the Onset of International Crises. Journal of Global Security Studies, 3(2), 198-216. https://doi.org/10.1093/jogss/ogy004 google scholar
• Lupton, D. L. (2020). Reputation for resolve: How Leaders signal determination in internationaL poLitics. Cornell University Press. google scholar
• Maness, R. C., & VaLeriano, B. (2016). The impact of cyber conflict on internationaL interactions. Armed Forces & Society, 42(2), 301-323. google scholar
• McCLeLLand, C. (1978). WorLd event/interaction survey, 1966-1978. WEIS Codebook ICPSR, 5211(640), 49. google scholar
• McManus, R. W. (2014). Fighting words: The effectiveness of statements of resoLve in internationaL conflict. Journal of Peace Research, 51(6), 726-740. google scholar
• Medzihorsky, J., Popovic, M., & Jenne, E. K. (2017). Rhetoric of civil conflict management: United Nations Security CounciL debates over the Syrian civiL war. Research & Politics, 4(2). https://doi.org/10.1177/2053168017702982 google scholar
• Oktay, S. (2014). Constraining or enabLing? The effects of government composition on international commitments. Journal of European Public Policy, 21(6), 860-884. https://doi.org/10.1080/13501763.2014.910870 google scholar
• Özdamar, Ö., & CanboLat, S. (2023). Leaders in the MiddLe East and North Africa: How IdeoLogy Shapes Foreign PoLicy. Cambridge University Press. google scholar
• Özdamar, Ö., HaListoprak, B. T., & Young, M. (2023). Do campaign speeches predict foreign policy? An operationaL code and Leadership trait anaLysis of DonaLd Trump’s MENA poLicies. Uluslararası İlişkiler Dergisi, 20(80), 73-91. google scholar
• RaLeigh, C., Linke, R., Hegre, H., & KarLsen, J. (2010). Introducing ACLED: An armed conflict Location and event dataset. Journal of peace research, 47(5), 651-660. google scholar
• Sakamoto, T. (2023). Threat conceptions in global security discourse: anaLyzing the speech records of the United Nations security council, 1990-2019. International Studies Quarterly, 67(3). google scholar
• Sallan GÜL, S., & Kahya Nizam, Ö. (2020). SOSYAL BİLİMLERDE İÇERİK VE SÖYLEM ANALİZİ. PamukkaLe University Journal of Social Sciences Institute. https://doi.org/l0.30794/pausbed.803182 google scholar
• Schafer, M., & WaLker, S. G. (2006). Democratic Leaders and the democratic peace: The operational codes of Tony Blair and Bill Clinton. International Studies Quarterly, 50(3), 561-583. google scholar
• Schumacher, G., SchoonveLde, M., Traber, D., Dahiya, T., & De Vries, E. (2016). EUSpeech: A new dataset of EU eLite speeches. google scholar
• Schrodt, P. A., Davis, S. G., & Weddle, J. L. (1994). Political science: KEDS—a program for the machine coding of event data. Social Science Computer Review, 12(4), 561-587. google scholar
• Schrodt, P. A., Simpson, E. M., & Gerner, D. J. (2001). Monitoring conflict using automated coding of newswire reports: a comparison of five geographicaL regions. Conference ‘Identifying Wars: Systematic Conflict Research and it’s UtiLity in Conflict ResoLution and Prevention’, UppsaLa, google scholar
• Singer, J. D. (1963). Inter-nation influence: a formaL modeL. The American Political Science Review, 57(2), 420-430. google scholar
• Spahiu, A. (2011). Franjo Tudjman's and SLobodan MiLosevic's OperationaL Code and Leadership Trait AnaLysis. google scholar
• Stewart, B. M., & Zhukov, Y. M. (2009). Use of force and civil-military relations in Russia: an automated content analysis. Small Wars & Insurgencies, 20(2), 319-343. google scholar
• Thyne, C., PoweLL, J., Parrott, S., & VanMeter, E. (2017). Even GeneraLs Need Friends. Journal of Conflict Resolution, 62(7), 1406-1432. https:// doi.org/10.1177/0022002716685611 google scholar
• Thyne, C. L. (2009). How InternationaL ReLations Affect CiviL Conflict: Cheap SignaLs, CostLy Consequences. Rowman & LittLefieLd. google scholar
• Ünver, H. A. (2019). ComputationaL internationaL reLations what can programming, coding and internet research do for the discipline?. All Azimuth: A Journal of Foreign Policy and Peace, 8(2), 157-182. google scholar
• Vincent, J. E. (1983). WEIS vs. COPDAB: Correspondence probLems. International Studies Quarterly, 27(2), 161-168. google scholar
• White, A. (2022). Profiling the President: expLaining Donald Trump’s nationaListic foreign policy decisions using Leadership Trait Analysis and OperationaL Code Analysis. Contemporary Voices: St Andrews Journal of International Relations, 4(1), 5-48. google scholar
• Wilson, M., Davis, D. R., & Murdie, A. (2016). The view from the bottom: Networks of conflict resolution organizations and internationaL peace. Journal of Peace Research, 53(3), 442-458. google scholar
• Wimmer, A., & Min, B. (2006). From empire to nation-state: Explaining wars in the modern world, 1816-2001. American sociological review, 71(6), 867-897. google scholar