Abstract
ChatGPT is a language model developed by OpenAI that uses generative artificial intelligence (GenAI) algorithms for natural language processing (NLP) tasks. It is a popular Chatbot due to its impressive ability to respond consistently to users' various prompts. In this study, the Public Personnel Selection Examination (KPSS) questions, organized by ÖSYM (Turkish Student Selection and Placement Center) every year, were asked to ChatGPT, and its performance was evaluated. The evaluation was made based on fundamental text questions asked in the last three years (2021-2023) in Biology, History, Geography, Turkish Language Literature, and Social Studies in KPSS. This study also aims to investigate the accuracy and reliability of the questions asked to ChatGPT in the field of KPSS educational sciences. According to the research results, ChatGPT's KPSS knowledge and interpretation skills are significantly lower than the university graduate candidates who took the exam. Some suggestions are included for better Chatbot performance, more effective prompt engineering and ethical use of these tools.
Keywords
References
- Awasthi, I., Gupta, K., Bhogal, P. S., Anand, S. S., & Soni, P. K. (2021). Natural language processing (NLP) based text summarization-a survey. 2021 6th International Conference on Inventive Computation Technologies (ICICT). 10.24926/iip.v13i2.4839. https://doi.org/10.1109/ICICT50816.2021.9358703
Abstract
References
- Awasthi, I., Gupta, K., Bhogal, P. S., Anand, S. S., & Soni, P. K. (2021). Natural language processing (NLP) based text summarization-a survey. 2021 6th International Conference on Inventive Computation Technologies (ICICT). 10.24926/iip.v13i2.4839. https://doi.org/10.1109/ICICT50816.2021.9358703
Details
| Primary Language | English |
|---|---|
| Subjects | Instructional Technologies |
| Journal Section | Articles |
| Authors | |
| Early Pub Date | September 26, 2024 |
| Publication Date | October 18, 2024 |
| Submission Date | January 3, 2024 |
| Acceptance Date | September 26, 2024 |
| Published in Issue | Year 2024 Volume: 9 Issue: 4 |
Cite
International Journal of Educational Research Review (ISSN:2458-9322)
International Journal of Educational Research Review publishes scholarly articles that are of general significance to the education research community and that come from a wide range of areas. The International Journal of Educational Research Review aims to provide a forum for scholarly understanding of the field of education. Articles focus upon concepts, research, review and practices that emphasizes the intersections between education research and other fields, raises new questions, and develops innovative approaches to our understandings of pressing issues.
The range of topics covered in the International Journal of Educational Research Review include; read full aims and scope; https://www.ijere.com/page/journal-scopes
Peer Review Policy: All articles in this journal will undergo initial editor screening, rigorous double-anonymous peer review, and review by the editorial board.
Double-blind peer review
International Journal of Educational Research Review follows a double-blind reviewing procedure. This means that the author will remain anonymous to the reviewers throughout peer review. It is the responsibility of the author to anonymize the manuscript and any associated materials. read full Peer Review Policy; https://www.ijere.com/page/peer-review-policy
Ownership and management
IJERE journal is hosted by Dergipark/Tubitak. IJERE Journal is published with the support of Sakarya University Faculty of Education/TURKEY.
Governing body
Editor in Chief
Dr. Serhat Arslan, Gazi University, serhatarslan@gazi.edu.tr , Turkey
read full Governing body /Ownership and management/ Editorial board member ; https://www.ijere.com/page/editorial-board
Copyright and licensing
Copyright Statement
Copyright violation is an important, and possibly related, ethical issue. Authors should check their manuscripts for possible breaches of copyright law (e.g., where permissions are needed for quotations, artwork or tables taken from other publications or from other freely available sources on the Internet) and secure the necessary permissions before submission to International Journal of Educational Research Review.
read full Copyright and licensing; https://www.ijere.com/page/copyright-and-licensing-open-access-statement