Conducting Academic Research with the AI Interface ChatGPT: Challenges and Opportunities

Year 2023, Volume: 6 Issue: 2, 101 - 118, 01.06.2023

İsmail Dönmez Sahin Idin , Salih Gülen

Abstract

Artificial intelligence technologies have become popular in recent years. The question of whether chatboxes can be used in academic writing or research in artificial intelligence applications attracts the attention of many researchers. Can conducting scientific research with artificial intelligence help in the research process? Can AI work like a co-writer? In this study, the opportunities and challenges experienced in the scientific research process using the ChatGPT application were examined. It critiqued and included a previous study in the scientific research process under specific themes. The results show that while artificial intelligence technologies provide opportunities to researchers in terms of approval, creativity, and offering different perspectives, it is seen that there are reliability problems in producing content and it brings ethical and plundering issues. Therefore, artificial intelligence does not write articles for you but provides some tips and support in article writing.

Keywords

Artificial Intelligence, AI, ChatGPT, Chatbox

References

• Alshater, M. (2022). Exploring the role of artificial intelligence in enhancing academic performance: A case study of ChatGPT. http://dx.doi.org/10.2139/ssrn.4312358
• Aydin, O., & Karaarslan, E. (2022). OpenAI ChatGPT generated literature review: Digital twin in healthcare. In Ö. Aydın (Ed.), Emerging Computer Technologies 2 (pp. 22-31). Izmir Academy Association.
• Chatterjee, J., & Dethlefs, N. (2023). This new conversational AI model can be your friend, philosopher, and guide... and even your worst enemy. Patterns, 4(1), 1-3. https://doi.org/10.1016/j.patter.2022.100676
• Connelly, F. M., & Clandinin, D. J. (1990). Stories of experience and narrative inquiry. Educational researcher, 19 (5), 2-14. https://doi.org/10.3102/0013189X019005002
• Cresswell, J. W. (2003). Research design: qualitative, quantitative and mixed methods approaches . Sage Publications, Thousand Oaks.
• Deryugina, O. V. (2010). Chatterbots. Scientific and Technical Information Processing, 37, 143-147. https://doi.org/10.3103/S0147688210020097
• Dönmez, I., Idin, S., & Gürbüz, S. (2022). Determining lower-secondary students' STEM motivation: A profile from Turkey. Journal of Baltic Science Education, 21(1), 38-51.
• Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2019). Artificial intelligence for decision making in the era of Big Data–evolution, challenges and research agenda. International journal of information management, 48, 63-71. https://doi.org/10.1016/j.ijinfomgt.2019.01.021
• Fast, NJ, & Schroeder, J. (2020). Power and decision-making: New directions for research in the age of artificial intelligence. Current opinion in psychology, 33, 172-176. https://doi.org/10.1016/j.copsyc.2019.07.039
• Følstad, A., Araujo, T., Law, E. L. C., Brandtzaeg , P. B., Papadopoulos, S., Reis, L. , ... & Luger, E. (2021). Future directions for chatbot research: an interdisciplinary research agenda. Computing, 103(12), 2915-2942. https://doi.org/10.1007/s00607-021-01016-7
• Gordijn, B., Have, HT (2023). ChatGPT: evolution or revolution?. Med Health Care and Philos. https://doi.org/10.1007/s11019-023-10136-0
• Green, L., Van Royen, K., & Vermeulen, A. (2019). Narrative research methods particularly focused upon digital technology use in everyday life. Narratives in Research and Interventions on Cyberbullying among Young People, 47-60.
• Grimaldi, G. & Ehrler, B. (2023). AI et al.: machines are about to change scientific publishing forever. ACS Energy Lett. 8 , 878–880. https://doi.org/10.1021/acsenergylett.2c02828
• Hosseini, M., LM Rasmussen, and DB Resnik. (2023). Using AI to write scholarly publications. Accountability in Research . 1–9. https://doi.org/10.1080/089896211.2023.2168535
• Jiao, W., Wang, W., Huang, JT, Wang, X., & Tu, Z. (2023). Is ChatGPT a good translator? A preliminary study. https://doi.org/10.48550/arXiv.2301.08745
• Kim, J. H. (2016). Understanding narrative inquiry: The crafting and analysis of stories as research . California: Sage.
• Kirmani, A. R. (2022). Artificial intelligence-enabled science poetry, ACS Energy Letters, 8, 574-576. https://doi.org/10.1021/acsenergylett.2c02758
• Kramp, M. K. (2004). Exploring life and experience through narrative inquiry . In: de Marris, K., Lapan, S. (eds.) Foundations of Research: Methods of Inquiry in Education and the Social Sciences, pp. 103–122. Lawrence Erlbaum, NJ.
• Lieberman, M. (2023). What Is ChatGPT and how Is It used in education?. Education week. (Access 15 February 2023: at; https://www.edweek.org/technology/what-is-chatgpt-and-how-is-it-used-in-education/2023/01)
• Lucy, L. & Bamman, D. (2021). Gender and representation bias in GPT-3 generated stories , Proceedings of the Workshop on Narrative Understanding, 3, 48-55. https://doi.org/10.18653/v1/2021.nuse-1.5 _
• Luo, B., Lau, RY, Li, C., & Si , Y. W. (2022). A critical review of state‐of‐the‐art chatbot designs and applications. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 12 (1), 1-12. https://doi.org/10.1002/widm.1434
• Maedche, A., Legner, C., Benlian, A., Berger, B., Gimpel, H., Hess, T., ... & Söllner, M. (2019). AI-based digital assistants: Opportunities, threats, and research perspectives. Business & Information Systems Engineering, 61, 535-544.
• Mollman, S. (2022, December 9). ChatGPT has gained 1 million followers in a single week. Here's why the AI chatbot is primed to disrupt search as we know it. Yahoo Finance . (Accessed 15 February 2023, at: https://consent.yahoo.com/v2/collectConsent?sessionId=3_cc-session_21842552-79ae-41b3-849d-bcfc80fc9db6)
• Nagarhalli, T. P., Vaze, V., Rana, N. (2020). A review of current trends in the development of chatbot systems. In Proceedings of the 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India, 6–7 March 2020; pp. 706–710.
• Open AI, (2023) Openai blog chatgpt. (Accessed 1 February 2023, at: https://openai.com/blog/chatgpt/)
• Reddy, T. (2017). How chatbots can help reduce customer service costs by 30%. https://www.ibm.com/blogs/watson/2017/10/how-chatbots-reduce-customer-service-costs-by-30-percent. Accessed 22 March 2019
• Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning and Teaching, 6(1), 1-22. https://doi.org/10.37074/jalt.2023.6.1.9
• Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023). ChatGPT and other large language models are double-edged swords. Radiology, 230163. https://doi.org/10.1148/radiol.230163
• Smestad, T. L. (2018). Personality Matters! Improving The User Experience of Chatbot Interfaces-Personality provides a stable pattern to guide the design and behavior of conversational agents (Master's thesis, NTNU).
• Taecharungroj, V. (2023). “What Can ChatGPT Do?” analyzing early reactions to the innovative AI chatbot on Twitter. Big Data and Cognitive Computing, 7(1), 1-10. https://doi.org/10.3390/bdcc7010035
• Tlili, A., Shehata, B., Adarkwah , M. A. et al. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. SmartLearn. environ. 10, 15. https://doi.org/10.1186/s40561-023-00237-x
• Uğuz Arsu, S. & Tekindal, M. (2021). Definition, scope and process of narrative research in qualitative research. Beyond the Horizon Science Journal, 21 (1), 85-124. Vallance , C. (2022). ChatGPT : New AI chatbot has everyone talking to it. (Accessed 23 December 2022; at; https://www.bbc.com/news/technology-63861322)
• Xu, L., Sanders, L., Li, K.; Chow, J.C. (2021). Chatbot for health care and oncology applications using artificial intelligence and machine learning: Systematic review. JMIR Cancer, 7 (4), 1-18. https://doi.org/10.2196/27850
• Zhai , X. (2022). ChatGPT user experience: Implications for education. SSRN Electronic Journal . https://doi.org/10.2139/ssrn.4312418