Araştırma Makalesi

Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT

Cilt: 9 Sayı: 4 18 Ekim 2024
Ali Öter , Betül Ersöz *, Halil İbrahim Bülbül , Şeref Sağıroğlu
PDF İndir
International Journal of Educational Research Review Kapak International Journal of Educational Research Review
EN

Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT

Abstract

ChatGPT is a language model developed by OpenAI that uses generative artificial intelligence (GenAI) algorithms for natural language processing (NLP) tasks. It is a popular Chatbot due to its impressive ability to respond consistently to users' various prompts. In this study, the Public Personnel Selection Examination (KPSS) questions, organized by ÖSYM (Turkish Student Selection and Placement Center) every year, were asked to ChatGPT, and its performance was evaluated. The evaluation was made based on fundamental text questions asked in the last three years (2021-2023) in Biology, History, Geography, Turkish Language Literature, and Social Studies in KPSS. This study also aims to investigate the accuracy and reliability of the questions asked to ChatGPT in the field of KPSS educational sciences. According to the research results, ChatGPT's KPSS knowledge and interpretation skills are significantly lower than the university graduate candidates who took the exam. Some suggestions are included for better Chatbot performance, more effective prompt engineering and ethical use of these tools.

Keywords

ChatGPT , GenAI , KPSS , LLM , Prompt Engineering

Kaynakça

  1. Awasthi, I., Gupta, K., Bhogal, P. S., Anand, S. S., & Soni, P. K. (2021). Natural language processing (NLP) based text summarization-a survey. 2021 6th International Conference on Inventive Computation Technologies (ICICT). 10.24926/iip.v13i2.4839. https://doi.org/10.1109/ICICT50816.2021.9358703

Ayrıntılar

Birincil Dil

İngilizce

Konular

Öğretim Teknolojileri

Bölüm

Araştırma Makalesi

Yazarlar

Erken Görünüm Tarihi

26 Eylül 2024

Yayımlanma Tarihi

18 Ekim 2024

Gönderilme Tarihi

3 Ocak 2024

Kabul Tarihi

26 Eylül 2024

Yayımlandığı Sayı

Yıl 2024 Cilt: 9 Sayı: 4

DOI

https://doi.org/10.24331/ijere.1414256

IZ

https://izlik.org/JA63DG92AG

Kaynak Göster

RIS / Bibtex
APA
Öter, A., Ersöz, B., Bülbül, H. İ., & Sağıroğlu, Ş. (2024). Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT. International Journal of Educational Research Review, 9(4), 269-274. https://doi.org/10.24331/ijere.1414256
AMA
1.Öter A, Ersöz B, Bülbül Hİ, Sağıroğlu Ş. Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT. IJERE. 2024;9(4):269-274. doi:10.24331/ijere.1414256
Chicago
Öter, Ali, Betül Ersöz, Halil İbrahim Bülbül, ve Şeref Sağıroğlu. 2024. “Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT”. International Journal of Educational Research Review 9 (4): 269-74. https://doi.org/10.24331/ijere.1414256.
EndNote
Öter A, Ersöz B, Bülbül Hİ, Sağıroğlu Ş (01 Ekim 2024) Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT. International Journal of Educational Research Review 9 4 269–274.
IEEE
[1]A. Öter, B. Ersöz, H. İ. Bülbül, ve Ş. Sağıroğlu, “Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT”, IJERE, c. 9, sy 4, ss. 269–274, Eki. 2024, doi: 10.24331/ijere.1414256.
ISNAD
Öter, Ali - Ersöz, Betül - Bülbül, Halil İbrahim - Sağıroğlu, Şeref. “Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT”. International Journal of Educational Research Review 9/4 (01 Ekim 2024): 269-274. https://doi.org/10.24331/ijere.1414256.
JAMA
1.Öter A, Ersöz B, Bülbül Hİ, Sağıroğlu Ş. Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT. IJERE. 2024;9:269–274.
MLA
Öter, Ali, vd. “Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT”. International Journal of Educational Research Review, c. 9, sy 4, Ekim 2024, ss. 269-74, doi:10.24331/ijere.1414256.
Vancouver
1.Ali Öter, Betül Ersöz, Halil İbrahim Bülbül, Şeref Sağıroğlu. Using Generative Artificial Intelligence in Exams: A Research on KPSS with ChatGPT. IJERE. 01 Ekim 2024;9(4):269-74. doi:10.24331/ijere.1414256

Cited By

Yapay Zekâ Teknikleriyle Yükseköğretim Kurumları Sınavı (YKS) Puanlarının Tahmini

Gazi Üniversitesi Fen Bilimleri Dergisi Part C: Tasarım ve Teknoloji

https://doi.org/10.29109/gujsc.1509217

ChatGPT는 건강운동관리사 이론시험에 합격할 수 있을까?

The Korean Journal of Physical Education

https://doi.org/10.23949/kjpe.2025.3.64.2.2

Performance of Generative Artificial Intelligence Models (GPT-4o, Gemini, Copilot) in YKS/TYT Exam: A Comparative Study

Bilişim Teknolojileri Dergisi

https://doi.org/10.17671/gazibtd.1575755

International Journal of Educational Research Review (ISSN:2458-9322)
International Journal of Educational Research Review publishes scholarly articles that are of general significance to the education research community and that come from a wide range of areas. The International Journal of Educational Research Review aims to provide a forum for scholarly understanding of the field of education. Articles focus upon concepts, research, review and practices that emphasizes the intersections between education research and other fields, raises new questions, and develops innovative approaches to our understandings of pressing issues.
The range of topics covered in the International Journal of Educational Research Review include; read full aims and scope; https://www.ijere.com/page/journal-scopes
Peer Review Policy: All articles in this journal will undergo initial editor screening, rigorous double-anonymous peer review, and review by the editorial board.
Double-blind peer review
International Journal of Educational Research Review follows a double-blind reviewing procedure. This means that the author will remain anonymous to the reviewers throughout peer review. It is the responsibility of the author to anonymize the manuscript and any associated materials. read full Peer Review Policy; https://www.ijere.com/page/peer-review-policy
Ownership and management
IJERE journal is hosted by Dergipark/Tubitak. IJERE Journal is published with the support of Sakarya University Faculty of Education/TURKEY.
Governing body
Editor in Chief
Dr. Serhat Arslan, Gazi University, serhatarslan@gazi.edu.tr ,  Turkey
read full Governing body /Ownership and management/ Editorial board member ; https://www.ijere.com/page/editorial-board
Copyright and licensing
Copyright Statement
Copyright violation is an important, and possibly related, ethical issue. Authors should check their manuscripts for possible breaches of copyright law (e.g., where permissions are needed for quotations, artwork or tables taken from other publications or from other freely available sources on the Internet) and secure the necessary permissions before submission to International Journal of Educational Research Review.
read full Copyright and licensing; https://www.ijere.com/page/copyright-and-licensing-open-access-statement