NLP and Figurative Language: A Quantitative Study Exploring the Competence of AI-Powered Bots in Understanding Metaphors and Idioms

Year 2025, Volume: 9 Issue: 1, 32 - 55, 31.12.2025

Abdulrahman Alhaydar

https://doi.org/10.61969/jai.1613027

Abstract

The rapid advancement of technology has led to the development of intelligent software tools that can almost impersonate humans in understanding human language. This has led to a significant advancement in natural language processing (NLP), which combines artificial intelligence with computational linguistics to produce and understand natural languages. The question remains whether these tools can handle the complexity of human language. To determine this, two types of human language, metaphors and idioms, were collected to test the ability of modern AI tools, ChatGPT and Google Bard, in understanding figurative language correctly. These complex languages require advanced intellectual abilities to comprehend. The data included sample sentences from both English and Turkish. Although their performance with metaphors was not as good as with idioms, the findings demonstrated that these AI-powered chatbots have a near-human knowledge of language, showing a high level of proficiency in processing human language.

Keywords

NLP , ChatGPT , Google Bard , Metaphor , Idiom

References

• Ágnes, A. (2009). The use of metaphors in advertising. Argumentum, 5, 18-24.
• Aksan, M. (2006). The container metaphor in Turkish expressions of anger. Dil Ve Edebiyat Dergisi, 3(2), 1-20.
• Aksan, Y., & Kantar, D. (2008). No wellness feels better than this sickness: Love metaphors from a cross-cultural perspective. Metaphor and Symbol, 23(4), 262-291.
• Ali, A. S., & Shandilya, V. K (2021). AI-natural language processing (NLP). International Journal for Research in Applied Science & Engineering Technology (IJRASET), 9(8), 135-140. https://doi.org/10.22214/ijraset.2021.37293
• Ali, R., Tang, O. Y., Connolly, I. D., Fridley, J. S., Shin, J. H., Zadnik S., Patricia L., Cielo, D., Oyelese, A. A., Doberstein, C. E., Telfeian, A. E., Gokaslan, Z. L., & Asaad, W. F. (2023). Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank. Neurosurgery, 93(5), 1090-1098. https://doi:10.1227/neu.0000000000002551/
• Alithya. (2023). Microsoft 365 Copilot: the AI assistant that revolutionizes work. Alithya. https://www.alithya.com/en/insights/blog-post/microsoft-365-copilot-ai-assistant-revolutionizes-work/
• Alomari, E. A. (2024). Unlocking the potential: A comprehensive systematic review of ChatGPT in natural language processing tasks. Computer Modeling in Engineering & Sciences, 141(1), 43-85. https://doi.org/10.32604/cmes.2024.052256
• Ammer, C. (2013). The American heritage dictionary of idioms. Houghton Mifflin Harcourt.
• Balakrishnan, V., & Lloyd-Yemoh, E. (2014). Stemming and lemmatization: A comparison of retrieval performances. Lecture Notes on Software Engineering, 2(3), 262-267. Doi:10.7763/lnse.2014.v2.134/
• Barcelona, A. (2003). Introduction. The cognitive theory of metaphor and metonymy. In A. Barcelona (Ed.), Metaphor and metonymy at the crossroads (pp. 1-28). Mouton de Gruyter.
• Belcic, I. & Stryker, C. (2024). What is Claude AI? IBM. https://www.ibm.com/think/topics/claude-ai/
• Bunt, H., & Petukhova, V. (2023). Semantic and pragmatic precision in conversational AI systems. Front. Artif. Intell., 6, 1-16. https://doi.org/10.3389/frai.2023.896729
• Cacciari, C., & Papagno, C. (2012). Neuropsychological and neurophysiological correlates of idiom understanding: How many hemispheres are involved? In M. Faust (Ed.), The handbook of the neuropsychology of language, Vol. 1. Language processing in the brain: Basic science, Vol. 2. Language processing in the brain: Clinical populations (pp. 368-385). Wiley Blackwell.
• Can, H., & Daşkın, N. C. (2010). The inner self desires a friendly chat: Chat metaphors in Turkish and English. Metaphor and Symbol, 25(1), 34-55.
• Colston, H. (2015). Using figurative language. Cambridge University Press.
• Erdener, Y. (2004). 101 Turkish idiomatic expressions. McNeil Technologies, Inc.
• Fryer, L., & Carpenter, R. (2006). Bots as language learning tools. Language, Learning and Technology, 10(3), 8-14.
• Gairns, R., & Redman, S. (1986). Working with words: A guide to teaching and learning vocabulary. Cambridge University Press.
• Gibbs, R. W. (1994). The poetics of mind: Figurative thought, language, and understanding. Cambridge University Press.
• Gibbs, R. W. (2006). Cognitive linguistics and metaphor research: Past successes, skeptical questions, future challenges. DELTA Documentação de Estudos em Lingüística Teórica e Aplicada, 22, 1-20.
• Goar, V., Yadav, N. S., & Yadav, P. S. (2023). Conversational AI for natural language processing: An review of ChatGPT. International Journal on Recent and Innovation Trends in Computing and Communication, 11(3s), 109-117. https://doi.org/10.17762/ijritcc.v11i3s.6161
• Gökçe, S. (2021). Metaphorical and metonymical heart in Turkish: Kalp and yürek. Dil Ve Edebiyat Araştırmaları, 24, 279-301. https://doi.org/10.30767/diledeara.881269
• Grefenstette, G., & Tapanainen, P. (1994). What is a word, what is a sentence? Problems of tokenization. Proceedings of the 3rd Conference on Computational Lexicography and Text Research, 79-87.
• Guzman, A. L. (2017). Making AI safe for humans: A conversation with Siri. In R. W. Gehl & M. Bakardjieva (Eds.), Socialbots and their friends: Digital media and the automation of sociality (pp. 69-85). Routledge.
• Haenlein, M., & Kaplan, A. (2019). A brief history of artificial ıntelligence: On the past, present, and future of artificial ıntelligence. California Management Review, 18(4), 1-10. https://doi.org/10.1177/0008125619864925
• Hurford, J. R., Heasley, B., & Smith, M. B. (2007). Semantics: A coursebook. Cambridge University Press.
• Hutauruk, B. S. (2019). The use of figuratıve languages on the students’ poetry semester v at fkip universitas hkbp nommensen. Journal of English Language and Culture, 9(2), 128-137.
• İbe Akcan, P., & Uçar, A. (2022). Türkçede annelik ve babalık metaforlarının derlem temelli çözümlemesi. Ankara Üniversitesi Dil Ve Tarih-Coğrafya Fakültesi Dergisi, 62(1), 701-720. https://doi.org/10.33171/10.33171/dtcfjournal.2022.62.1.28
• Jha, A. K. (2019). Journey to the realm of chatbots. International Journal of Research in Engineering, Science and Management, 2(4), 45-48.
• Johnson, G., & Arp, T. R. (2016). Perrine’s literature: Structure, sound & sense. Cengage Learning.
• Kainulainen, T. (2006). Understanding Idioms: A comparison of Finnish third-grade students of national senior secondary school and IB diploma programme. (Pro Gradu Thesis in English). Department of Languages, University of Jyväskylä.
• Kocoń, J., Cichecki, I., Kaszyca, O., Kochanek, M., Szydło, D., Baran, J., Bielaniewicz, J., Gruza, M., Janz, A., Kanclerz, K., Kocoń, A., Koptyra, B., Mieleszczenko-Kowszewicz, W., Miłkowski, P., Oleksy, M., Piasecki, M., Radliński, Ł., Wojtasik, K., Woźniak, S., & Kazienko, P. (2023). ChatGPT: Jack of all trades, master of none. Information Fusion, 99(2), 1-37. https://doi.org/10.1016/j.inffus.2023.101861
• Koubaa, A., Boulila, W., Ghouti, L., Alzahem, A., & Latif, S. (2023). Exploring ChatGPT capabilities and limitations: A critical review of the NLP game changer. Preprints. https://doi.org/10.20944/preprints202303.0438.v1
• Lakoff, G., & Johnson, M. (1980). Metaphors we live by. The University of Chicago Press.
• Lakoff, G., & Johnson, M. (1980). The metaphorical structure of the human conceptual system. Cognitive Science, 4(2), 195-208.
• Liddy, E. D. (2001). Natural language processing. In Encyclopedia of library and ınformation science (2nd ed.). Marcel Decker, Inc.
• Lovins, J. B. (1968). Development of a stemming algorithm. Mechanical Translation and Computational Linguistics, 11(1-2), 22-31.
• Mansouri, A. Affendey, L. S., & Mamat, A. (2008). Named entity recognition approaches. IJCSNS International Journal of Computer Science and Network Security, 8(2), 339-344.
• Masters, J., & Masters, P. (2006). 1,001 Essential Turkish idioms (for English speakers). Habibullah Enterprises.
• Nadkarni, P. M., Ohno-Machado, L., & Chapman, W. W. (2011). Natural language processing: An introduction. J Am Med Inform Assoc, 18, 544-551. https://doi.org/10.1136/amiajnl-2011-000464
• Özçalışkan, S. (2003). Metaphorical motion in crosslinguistic perspective: A comparison of English and Turkish. Metaphor and Symbol, 18(3), 189-228.
• Rajkumar, R. (2024). What is AI? Everything to know about artificial intelligence. ZDNet. https://www.zdnet.com/article/what-is-ai-heres-everything-you-need-to-know-about-artificial-intelligence/
• Ram, B., & Verma, P. (2023). Artificial intelligence AI-based Chatbot study of ChatGPT, Google AI Bard and Baidu AI. World Journal of Advanced Engineering Technology and Sciences, 8(1), 258-261. https://doi.org/10.30574/wjaets.2023.8.1.0045
• Schmid, H. (1994). Part-of-speech tagging with neural networks. Proceedings of the 15th Conference on Computational Linguistics, 1, 172-176. https://doi.org/10.3115/991886.991915
• Seidl, J., & McMordie, W. (1988). English Idioms. Oxford University Press.
• Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023). ChatGPT and other large language models are double-edged swords. Radiology, 307(2). https://doi.org/10.1148/radiol.230163
• Shihab, S. R., Sultana, N., & Samad, A. (2023). Revisiting the use of ChatGPTin business and educational fields: Possibilities and challenges. BULLET : Jurnal Multidisiplin Ilmu, 2(3), 534-545.
• Steele, R., Baird, J., & Davies, B. (2022). Using Metaphors to Make Research Findings Meaningful. Canadian Journal of Nursing Research, 54(2), 99-100.
• Stefanowitsch, A. (2004). Happiness in English and German: A metaphorical-pattern analysis. In M. Achard & S. Kemmer (Eds.), Language, culture, and mind (pp. 137-149). CSLI Publications.
• Taboada, M. (2016). Sentiment analysis: An overview from linguistics. Annual Review of Linguistics, 2, 325-347. https://doi.org/10.1146/annurev-linguistics-011415-040518
• Turing, A. (1950). Computing machinery and intelligence. Mind, LIX(236), 433–460. https://doi.org/10.20944/preprints202303.0438.v1
• Vu, N. N. (2015). Structural, orientational, ontological conceptual metaphors and implications for language teaching. Ho Chi Minh City Open University Journal of Science, 5(1), 49-53.
• Wankhade, M. Rao, A. C. S., & Kulkarni, C. (2022). A survey on sentiment analysis methods, applications, and challenges. Artificial Intelligence Review, 55, 5731-5780. https://doi.org/10.1007/s10462-022-10144-1
• Weizenbaum, J. (1966). ELIZA — a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36-45. https://dl.acm.org/doi/pdf/10.1145/365153.365168/
• Wibisono, R. T., & Widodo, P. (2019). An analysis of figurative language in online short story posted on the Jakarta post. Prasasti: Journal of Linguistics, 4(2), 156-165.
• Winograd, T. (1980). What does ıt mean to understand language? Cognitive Science, 4, 209-241. https://doi.org/10.1207/s15516709cog0403_1
• Wright, J. (2002). Idiom Organiser: Organised by metaphor, topic and key word. Thomson.
• Zewe, A. (2025). Like human brains, large language models reason about diverse data in a general way. MIT. https://news.mit.edu/2025/large-language-models-reason-about-diverse-data-general-way-0219/
• Zhang, F., & Hu, J. (2009). A study of metaphor and its application in language learning and teaching. International Education Studies, 2(2), 77-81.
• Zhao, Y. (2023). The state-of-art applications of NLP: Evidence from ChatGPT. Highlights in Science Engineering and Technology, 49, 237-243.
• Zhong, Q., Ding, L., Liu, J., Du, B., & Tao, D. (2023). Can ChatGPT understand too? A comparative study on ChatGPT and fine-tuned BERT. http://dx.doi.org/10.48550/arXiv.2302.10198
• Zock, M. (2020). AI at the crossroads of NLP and neurosciences. Journal of Cognitive Science, 21(1), 1-14.