The Effect of Gamified Adaptive Intelligent Tutoring System Artibos on Problem-Solving Skills

Year 2023, Volume: 10 Issue: 1, 344 - 374, 30.01.2023

İsmail Çetin Ali Kürşat Erümit Vasif Nabiyev Hasan Karal Temel Kösa Mehmet Kokoç

https://doi.org/10.17275/per.23.19.10.1

Abstract

This study aims to examine the contribution of ArtiBos, which is designed as a Gamified Adaptive Intelligent Tutoring System for students' problem-solving skills. In the study, first of all, the system’s design features to improve problem-solving skills were examined, and then the effect of the system on problem-solving skills was evaluated. The study was carried out with 12 students studying in the ninth class of a High School in Türkiye and 6 mathematics teachers with different experiences working in the same school. A case study, one of the qualitative research methods were applied in this study through which ArtiBos system logs, student interviews, and teacher interviews were evaluated. Data pertaining to the number of solved problems, the number of problems created, the number of problems solved correctly, the duration of being online in the system, the rate of correct problem-solving, and the average solving time were examined to evaluate system logs. Interview questions have been prepared so that the contribution of system features to problem-solving skills can be evaluated. The data from the interview were analyzed and some codes for problem-solving skills were created. And then, sub-themes were created by combining the codes. The results show that ArtiBos affects students' problem-solving skills positively.

Keywords

problem solving skill, gamified tutoring system, adaptive intelligent tutoring system

Supporting Institution

TÜBİTAK

Project Number

215K029

Thanks

This study was funded by TÜBİTAK 215K029 Projects. This study is a part of unpublished doctoral thesis of first author.

References

• Alan, S. (2017). Problem genişletme etkinliklerinin problem çözme ve üstbilişe etkisi (Unpublished master’s thesis). Ordu University, Social Sciences Institue.
• Almasri, A., Ahmed, A., Almasri, N., Abu Sultan, Y. S., Mahmoud, A. Y., Zaqout, I. S., ... & Abu-Naser, S. S. (2019). Intelligent Tutoring Systems Survey for the Period 2000-2018, 3(5), 21-37.
• Aleven, V., Sewall, J., Andres, J. M., Popescu, O., Sottilare, R., Long, R., & Baker, R. (2019). Towards Deeper Integration of Intelligent Tutoring Systems: One-way Student Model Sharing between GIFT and CTAT. Paper presented at the 7th Annual Generalized Intelligent Framework for Tutoring (GIFT) Users Symposium (GIFTSym7). US Combat Capability Development Command–Soldier Center, Orlando, FL.
• Altun., M., & Arslan, Ç. (2006). İlköğretim öğrencilerinin problem çözme stratejilerini öğrenmeleri üzerine bir çalışma. Journal of Uludağ University Education Faculty, 19(1), 1-21.
• Altun, M. (2018). İlkokullarda Matematik Öğretimi. Bursa, Aktuel Publications.
• Annetta, L. A. (2008). Video games in education: Why they should be used and how they are being used. Theory into Practice, 47(3), 229–239. https://doi.org/10.1080/00405840802153940
• Arıkan, E. E., & Ünal, H. (2015). An investigation of eighth grade students' problem posing skills (Turkey sample). Online Submission, 1(1), 23-30.
• Baki, A. (2006). Kuramdan uygulamaya matematik eğitimi. Derya Bookstore: Trabzon, Turkey.
• Balım, A. G. (2009). The effects of discovery learning on students' success and inquiry learning skills. Eurasian Journal of Educational Research (EJER), 35, 1-20.
• Baumanns, L., & Rott, B. (2019). Is problem posing about posing “problems“? A terminological framework for research into problem posing and problem solving. In A. Kuzle, I. Gebel, & B. Rott (Eds.), 2018 Joint Conference of ProMath and the GDM Working Group on Problem Solving (pp. 21–31). Munster, Germany: WTM-Verlag.
• Boot, W. R.; Kramer, A. F.; Simons, D. J.; Fabiani, M. & Gratton, G. (2008). The effects of video game playing on attention, memory, and executive control. Acta Psychologica 129(3), 387-398.
• Bourke, B. (2019). Using gamification to engage higher-order thinking skills. In J. Keengwe, & R. Byamukama (Eds.), Handbook of Research on Promoting Higher-Order Skills and Global Competencies in Life and Work (pp. 1-12). IGI Global.
• Boyle, E. A., Hainey, T., Connolly, T. M., Gray, G., Earp, J., Ott, M., ... & Pereira, J. (2016). An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Computers & Education, 94, 178–192. https://doi.org/10.1016/j.compedu.2015.11.003
• Brown, S. I., & Walter, M. I. (2005). The art of problem posing. Psychology Press.
• Cai, J., & Hwang, S. (2002). Generalized and generative thinking in US and Chinese students’ mathematical problem solving and problem posing. The Journal of Mathematical Behavior, 21(4), 401-421. https://doi.org/10.1016/S0732-3123(02)00142-6
• Cai, J., Hwang, S., Jiang, C., & Silber, S. (2015). Problem-posing research in mathematics education: Some answered and unanswered questions. In F. Singer, N. F. Ellerton, & J. Cai (Eds.), Mathematical Problem Posing (pp. 3-34). Springer, New York, NY.
• Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. Sage publications.
• Davies, P. (2000). Contributions from Qualitative Research. In H. T. Davies, M. N. Sandra, & P. Smith (Eds). What works? Evidence-based Policy and Practice in Public Services (s. 291- 316), Bristol, UK: Policy Press.
• De Corte, E., Verschaffel, L., & Masui, C. (2004). The CLIA-model: A framework for designing powerful leaming environments for thinking and problem solving. European Journal of Psychology of Education, 19(4), 365-384. https://doi.org/10.1007/BF03173216
• Dewey, J., & Think, H. W. (1933). A restatement of the relation of reflective thinking to the educative process. Boston: DC Heath and Company.
• Drigas, A. S., & Pappas, M. A. (2015). On Line and Other Game-Based Learning for Mathematics. International Journal of Online Engineering, 11(4), 62-67. http://dx.doi.org/10.3991/ijoe.v11i4.4742
• English, L. D. (1997). The development of fifth grade children’s problem posing abilities. Educational Studies in Mathematics, 34(3), 183–217. https://doi.org/10.1023/A:1002963618035
• Ersoy, E., & Güner, P. (2014). Matematik öğretimi ve matematiksel düşünme. Eğitim ve Öğretim Araştırmaları Dergisi, 3(2), 102-112.
• Erümit, A. K. (2014). Polya’nın problem çözme adımlarına göre hazırlanmış yapay zekâ tabanlı öğretim ortamının öğrencilerin problem çözme süreçlerine etkisi (Unpublished doctoral dissertation). Karadeniz Technical University, Trabzon.
• Eseryel, D., Law, V., Ifenthaler, D., Ge, X., & Miller, R. (2014). An investigation of the interrelationships between motivation, engagement, and complex problem solving in game-based learning. Educational Technology & Society, 17(1), 42-53.
• Fidan, S. (2008). İlköğretim 5. sınıf matematik dersinde öğrencilerin problem kurma çalışmalarının problem çözme başarılarına etkisi (Unpublished master’s thesis). Gazi University Education Faculty.
• García, T., Boom, J., Kroesbergen, E. H., Núñez, J. C., & Rodríguez, C. (2019). Planning, execution, and revision in mathematics problem solving: Does the order of the phases matter?. Studies in Educational Evaluation, 61, 83-93. https://doi.org/10.1016/j.stueduc.2019.03.001
• Garofalo, J., & Lester Jr, F. K. (1985). Metacognition, cognitive monitoring, and mathematical performance. Journal for research in mathematics education, 16, 163-176. http://doi.org/10.2307/748391
• Gee, J. P. (2008). Learning and games. In K. Salen (Eds.), The ecology of games: Connecting youth, games, and learning (pp. 21-40). Cambridge, MA: MIT Press.
• Gopinath, S., & Lertlit, S. (2017). The implementation of polya’s model in solving problem-questions in mathematics by grade 7 students. Suranaree Journal of Social Science, 11(1), 47-59.
• Göksün, D. O., & Kurt, A. A. (2017). Öğretmen adaylarının 21. yy. öğrenen becerileri kullanımları ve 21. yy. öğreten becerileri kullanımları arasındaki ilişki. Eğitim ve Bilim, 42(190), 107-130. http://doi.org/10.15390/EB.2017.7089
• Greiff, S., Wüstenberg, S., Csapó, B., Demetriou, A., Hautamäki, J., Graesser, A. C., & Martin, R. (2014). Domain-general problem solving skills and education in the 21st century. Educational Research Review, (13), 74-83. http://doi.org/10.1016/j.edurev.2014.10.002
• Halmos, P. R. (1980). The heart of mathematics. The American Mathematical Monthly, 87(7), 519-524. https://doi.org/10.1080/00029890.1980.11995081
• Hämäläinen, R., De Wever, B., Nissinen, K., & Cincinnato, S. (2019). What makes the difference–PIAAC as a resource for understanding the problem-solving skills of Europe's higher-education adults. Computers & Education, 129, 27-36. https://doi.org/10.1016/j.compedu.2018.10.013
• Harskamp, E. G., & Suhre, C. J. (2006). Improving mathematical problem solving: A computerized approach. Computers in Human Behavior, 22(5), 801-815. https://doi.org/10.1016/j.chb.2004.03.023
• Heller, P., Keith, R., & Anderson, S. (1992). Teaching problem solving through cooperative grouping. Part 1: Group versus individual problem solving. American Journal of Physics, 60(7), 627-636. https://doi.org/10.1119/1.17117
• Hooshyar, D., Ahmad, R. B., Yousefi, M., Yusop, F. D., & Horng, S. J. (2016). A flowchart-based intelligent tutoring system for improving problem-solving skills of novice programmers. Journal of computer assisted learning, 31(4), 345-361. https://doi.org/10.1111/jcal.12099
• Hsu, C. C., & Wang, T. I. (2018). Applying game mechanics and student-generated questions to an online puzzle-based game learning system to promote algorithmic thinking skills. Computers & Education, 121, 73-88. https://doi.org/10.1016/j.compedu.2018.02.002
• Hwang, G. J., Sung, H. Y., Hung, C. M., Huang, I., & Tsai, C. C. (2012). Development of a personalized educational computer game based on students’ learning styles. Educational Technology Research and Development, 60(4), 623–638. https://doi.org/10.1007/s11423-012-9241-x
• International Society for Technology in Education [ISTE]. (2016). The ISTE national educational technology standards (NETS•S) and performance indicators for students. Retrieved May 15, 2020, from www.iste.org/standards/nets-for-students
• Jeremic, Z., Jovanovic, J., & Gasevic, D. (2012). Student modeling and assessment in intelligent tutoring of software patterns. Expert Systems with Application, 39(1), 210-222. https://doi.org/10.1016/j.eswa.2011.07.010
• Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26.
• Karataş, I., & Baki, A. (2017). The effect of learning environments based on problem solving on students’ achievements of problem solving. International Electronic Journal of Elementary Education, 5(3), 249-268.
• Katmada, A., Mavridis, A., & Tsiatsos, T. (2014). Implementing a Game for Supporting Learning in Mathematics. Electronic Journal of e-Learning, 12(3), 230-242.
• Kilpatrick, J. (1987). Where do good problems come from?. In A. H. Schoenfeld (Eds.), Cognitive Science and Mathematics Education (pp. 123-148). USA: Lawrencem Erlbaum Associates, Inc. Publishers.
• Lai, J. W., & Bower, M. (2019). How is the use of technology in education evaluated? A systematic review. Computers & Education, 133, 27-42. https://doi.org/10.1016/j.compedu.2019.01.010
• Lee, C. I. (2016). An appropriate prompts system based on the polya method for mathematical problem-solving. EURASIA Journal of Mathematics, Science and Technology Education, 13(3), 893-910. https://doi.org/10.12973/eurasia.2017.00649a
• Lester, J. C., Spires, H. A., Nietfeld, J. L., Minogue, J., Mott, B. W., & Lobene, E. V. (2014). Designing game-based learning environments for elementary science education: A narrative-centered learning perspective. Information Sciences, 264, 4-18. https://doi.org/10.1016/j.ins.2013.09.005
• Liao, C. W., Chen, C. H., & Shih, S. J. (2019). The interactivity of video and collaboration for learning achievement, intrinsic motivation, cognitive load, and behavior patterns in a digital game-based learning environment. Computers & Education, 133, 43-55. https://doi.org/10.1016/j.compedu.2019.01.013
• Liu, C. C., Cheng, Y. B., & Huang, C. W. (2011). The effect of simulation games on the learning of computational problem solving. Computers & Education, 57(3), 1907–1918. https://doi.org/10.1016/j.compedu.2011.04.002
• Magnisalis, I., Demetriadis, S., & Karakostas, A. (2011). Adaptive and intelligent systems for collaborative learning support: A review of the field. Transactions on Learning Technologies, 4(1), 5-20. http://doi.org/10.1109/TLT.2011.2
• Maharani, S., Kholid, M. N., Pradana, L. N., & Nusantara, T. (2019). Problem solving in the context of computational thinking. Infinity Journal, 8(2), 109-116. https://doi.org/10.22460/infinity.v8i2.p109-116
• Maulyda, M. A., Hidayati, V. R., Rosyidah, A. N. K., & Nurmawanti, I. (2019). Problem-solving ability of primary school teachers based on Polya’s method in Mataram City. Pythagoras, 14(2), 139-149. https://doi.org/10.21831/pg.v14i2.28686
• Mayer, R. E. (1985). Mathematical ability. In R. J. Sternberg (Eds.), Human abilities: An information processing approach (pp. 31-58). Freeman, New York.
• Melander Bowden, H. (2019). Problem-solving in collaborative game design practices: epistemic stance, affect, and engagement. Learning, Media and Technology, 44(2), 124-143. https://doi.org/10.1080/17439884.2018.1563106
• Nabiyev, V., Karal, H., Arslan, S., Erumit, A. K., & Cebi, A. (2013). An artificial intelligence-based distance education system: Artimat. Turkish Online Journal of Distance Education, 14(2), 81-98.
• OECD (2019). PISA 2018 assessment and analytical framework. Paris: OECD Publishing. doi:https://doi.org/10.1787/b25efab8-en
• Onwuegbuzie, A. J., ve Leech, N. L. (2004). Enhancing the Interpretation of “Significant” Findings: The Role of Mixed Methods Research. The Qualitative Report, 9(4), 770-792.
• Pathiratne, S. (2015, November). Instigating an Online Game as Mathematics Learning Support Tool. Paper presented at the 6th International Conference on Business & Information ICBI, Kelaniya, Sri Lanka.
• Perini, S., Luglietti, R., Margoudi, M., Oliveira, M., & Taisch, M. (2018). Learning and motivational effects of digital game-based learning (DGBL) for manufacturing education–The Life Cycle Assessment (LCA) game. Computers in Industry, 102, 40-49. https://doi.org/10.1016/j.compind.2018.08.005
• Phonapichat, P., Wongwanich, S., & Sujiva, S. (2014). An Analysis of Elementary School Students’ Difficulties in Mathematical Problem Solving. Procedia - Social and Behavioral Sciences, 116(2014), 3169–3174. https://doi.org/10.1016/j.sbspro.2014.01.728
• Pinter, K. (2012). On teaching mathematical problem-solving and problem posing (Unpublished doctoral dissertation). University of Szeged, Hungary.
• Polya, G. (1957). How to Solve It? (2 nd ed.). Princeton, N.J.: Princeton University Press.
• Pradika, I. D., Amin, S. M., & Khabibah, S. (2020). Relational thinking in problem solving mathematics based on adversity quotient and visual learning style. International Journal of Trends in Mathematics Education Research, 2(4), 161-164. https://doi.org/10.33122/ijtmer.v2i4.61
• Pratama, L., Lestari, W., & Jailani, J. (2019). Metacognitive skills in mathematics problem solving. Jurnal Inovasi Pendidikan Matematika, 6(3), 286-295. https://doi.org/10.26858/jds.v6i3.8537
• Reusser, K. and Stebler, R. (1997). Every word problem has a solution: The social rationality of mathematical modeling in schools. Learning and Instruction, 7(4), 309-327. https://doi.org/10.1016/S0959-4752(97)00014-5
• Rosen, Y., Wolf, I., & Stoeffler, K. (2020). Fostering collaborative problem solving skills in science: The Animalia project. Computers in Human Behavior, 104, 1-6. https://doi.org/10.1016/j.chb.2019.02.018
• Ruggiero, D., & Green, L. (2017). Problem solving through digital game design: A quantitative content analysis. Computers in Human Behavior, 73, 28-37. https://doi.org/10.1016/j.chb.2017.03.024
• Sari, R. H. N., & Wijaya, A. (2017). Mathematical literacy of senior high school students in Yogyakarta. Jurnal Riset Pendidikan Matematika, 4(1), 100-107. https://doi.org/10.21831/jrpm.v4i1.10649
• Shute, V. J., Wang, L., Greiff, S., Zhao, W., & Moore, G. (2016). Measuring problem solving skills via stealth assessment in an engaging video game. Computers in Human Behavior, 63, 106-117. https://doi.org/10.1016/j.chb.2016.05.047
• Silver, E. A. (1994). On mathematical problem posing. For The Learning of Mathematics, 14(1), 19-28.
• Silver, E. A., & Cai, J. (1996). An analysis of arithmetic problem posing by middle school students. Journal for Research in Mathematics Education, 27, 521-539. http://doi.org/10.2307/749846
• Simamora, R. E., Sidabutar, D. R., & Surya, E. (2017). Improving learning activity and students’ problem solving skill through problem based learning (PBL) in junior high school. International Journal of Sciences: Basic and Applied Research (IJSBAR), 33(2), 321-331.
• Singer, F. M., & Voica, C. (2015). Is problem posing a tool for identifying and developing mathematical creativity?. In F. Singer, N. Ellerton, & J. Cai (Eds.), Mathematical Problem Posing. Research in Mathematics Education (pp. 141-174). Springer, New York.
• Singer, F. M., Ellerton, N., & Cai, J. (2013). Problem-posing research in mathematics education: New questions and directions. Educational Studies in Mathematics, 83(1), 1-7. https://doi.org/10.1007/s10649-013-9478-2
• Sirin, S., Plass, J. L., Homer, B. D., Vatanartiran, S., & Tsai, T. (2018). Digital game-based education for Syrian refugee children: Project hope. Vulnerable Children and Youth Studies, 13(1), 7-18. https://doi.org/10.1080/17450128.2017.1412551
• Squire, K., & Barab, S. (2004, June). Replaying history: Engaging urban underserved students in learning world history through computer simulation games. Paper presented at the 6th International Conference on Learning Sciences, Santa Monica.
• Sun, C., Shute, V. J., Stewart, A., Yonehiro, J., Duran, N., & D'Mello, S. (2020). Towards a generalized competency model of collaborative problem solving. Computers & Education, 143, 1-17. https://doi.org/10.1016/j.compedu.2019.103672
• Tambychik, T., & Meerah, T. S. M. (2010). Students' difficulties in mathematics problem-solving: What do they say?. Procedia - Social and Behavioral Sciences, 8, 142-151. http://doi.org/10.1016/j.sbspro.2010.12.020.
• Taub, M., & Azevedo, R. (2019). How does prior knowledge influence eye fixations and sequences of cognitive and metacognitive srl processes during learning with an intelligent tutoring system?. International Journal of Artificial Intelligence in Education, 29(1), 1-28. https://doi.org/10.1016/j.learninstruc.2019.04.001
• Tias, A. A. W., & Wutsqa, D. U. (2015). Analisis kesulitan siswa SMA dalam pemecahan masalah matematika kelas XII IPA di Kota Yogyakarta. Jurnal Riset Pendidikan Matematika, 2(1), 28-39. https://doi.org/10.21831/jrpm.v2i1.7148
• Tohir, M. (2018). Students’ creative thinking skills in solving mathematics olympiad problems based on problem-solving polya and krulik-rudnick model. Advanced Science Letters, 24(11), 8361-8364. https://doi.org/10.1166/asl.2018.12563
• Tsay, C. H. H., Kofinas, A., & Luo, J. (2018). Enhancing student learning experience with technology mediated gamification: An empirical study. Computers & Education, 121, 1-17. http://doi.org/10.1016/j.compedu.2018.01.009
• Vaessen, B. E., Prins, F. J., & Jeuring, J. (2014). University students' achievement goals and help-seeking strategies in an intelligent tutoring system. Computers & Education, 72, 196-208. https://doi.org/10.1016/j.compedu.2013.11.001.
• Van de Wall, J. A., Karp, K. S., & Bay-Williams, J. M. (2010). Elementary & middle school mathematics: Teaching developmentally (7th ed). Boston, MA: Allyn and Bacon.
• Viberg, O., & Grönlund, Å. (2017). Understanding students’ learning practices: challenges for design and integration of mobile technology into distance education. Learning, Media and Technology, 42(3), 357-377. https://doi.org/10.1080/17439884.2016.1088869
• Vilenius-Tuohimaa, P. M., Aunola, K., & Nurmi, J. E. (2008). The association between mathematical word problems and reading comprehension. Educational Psychology, 28(4), 409-426. https://doi.org/10.1080/01443410701708228
• Wang, D., Han, H., Zhan, Z., Xu, J., Liu, Q., & Ren, G. (2015). A problem solving oriented intelligent tutoring system to improve students' acquisition of basic computer skills. Computers & Education, 81, 102-112. https://doi.org/10.1016/j.compedu.2014.10.003
• Wechsler, S. M., Saiz, C., Rivas, S. F., Vendramini, C. M. M., Almeida, L. S., Mundim, M. C., & Franco, A. (2018). Creative and critical thinking: Independent or overlapping components?. Thinking Skills and Creativity, 27, 114-122. https://doi.org/10.1016/j.tsc.2017.12.003
• Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., et al. (2009). Relationships between game attributes and learning outcomes: Review and research proposals. Simulation & Gaming, 40(2), 217–266. https://doi.org/10.1177/1046878108321866
• World Economic Forum (2020). Jobs of Tomorrow. Retrieved June 10, 2020, from http://www3.weforum.org/docs/WEF_Jobs_of_Tomorrow_2020.pdf
• Yeh, Y. C., Chang, H. L., & Chen, S. Y. (2019). Mindful learning: A mediator of mastery experience during digital creativity game-based learning among elementary school students. Computers & Education, 132, 63-75. https://doi.org/10.1016/j.compedu.2019.01.001
• Yüce, A., Abubakar, A. M., & İlkan, M. (2019). Intelligent tutoring systems and learning performance. Online Information Review, 43(4), 600-616.