The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning

Servet Kılıç; Seyfullah Gökoğlu

doi:10.17275/per.26.37.13.3

The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning

Abstract

Computational thinking (CT), which is based on the effective use of information processing tools in problem solving, can be developed through programming activities. Because programming is a complex structure requiring the use of strategic information (debugging, algorithmic thinking, evaluation, and others.) as well as conceptual knowledge (decisions, loops, operators, variables, arrays, and so on), novice students may experience difficulties in solving certain problems even after learning the basic concepts. This can limit the development of CT. Creating algorithmic structures through reasoning based on fundamental concepts depends on changing the focus of the training. This study aims to examine the effect of problem-solving-based programming training (PSbPT) on CT development in the context of programming performance and reasoning skills. PSbPT is a structure based on the use of CT components depending on the problem-solving stages. 40 students studying in the computer technology department of a state university underwent a 14-week programming training program. Participants were randomly assigned to groups in an experimental design with pre-test and post-test control groups. During the training process, students were presented with complex problem scenarios that integrated reasoning and programming and were based on CT components. The results showed that the programming performance and reasoning skills of the experimental group students who received PSbPT were statistically significantly improved compared to the control group. PSbPT was more effective than traditional programming training in terms of developing students' CT skills. The impact of the adopted PSbPT approach on programming, reasoning, and CT skills was discussed separately and holistically.

Keywords

computational thinking, programming, reasoning skills, problem-solving-based programming

Supporting Institution

The research did not receive any funding support

Ethical Statement

This research was conducted in accordance with the permission granted by the Ordu University Social and Human Sciences Research Ethics Committee with decision number 2022-125 dated 01/06/2022.

References

Aho, A. V. (2012). Computation and computational thinking. The Computer Journal, 55(7), 832–835. https://doi.org/10.1093/COMJNL/BXS074
Alferes, J. J., Pereira, L. M., & Przymusinski, T. C. (1996). Belief revision in non-monotonic reasoning and logic programming. Fundamenta Informaticae, 28(1–2), 1–22. https://doi.org/10.3233/FI-1996-281201
Angeli, C., Voogt, J., Fluck, A., Webb, M., Cox, M., Malyn-Smith, J., & Zagami, J. (2016). A K-6 computational thinking curriculum framework: Implications for teacher knowledge. Educational Technology & Society, 16(3), 47–57.
Aparicio, J. T., Aparicio, M., & Costa, C. J. (2018). A virtual robot to support programming learning. 50th International Symposium on Robotics, 139–142. https://ieeexplore.ieee.org/document/8470585
Asbell-Clarke, J., Rowe, E., Almeda, V., Edwards, T., Bardar, E., Gasca, S., Baker, R. S., & Scruggs, R. (2021). The development of students’ computational thinking practices in elementary- and middle-school classes using the learning game, Zoombinis. Computers in Human Behavior, 115, 106587. https://doi.org/10.1016/J.CHB.2020.106587
Atmatzidou, S., & Demetriadis, S. (2016). Advancing students’ computational thinking skills through educational robotics: A study on age and gender relevant differences. Robotics and Autonomous Systems, 75, 661–670. https://doi.org/10.1016/J.ROBOT.2015.10.008
Barbey, A. K., & Barsalou, L. W. (2009). Reasoning and problem solving: Models. Encyclopedia of Neuroscience, 35–43. https://doi.org/10.1016/B978-008045046-9.00435-6
Barr, D., Harrison, J., & Conery, L. (2011). Computational thinking: A digital age skill for everyone. Learning & Leading with Technology, 38(6), 20–23.
Bayman, P., & Mayer, R. E. (1988). Using conceptual models to teach basic computer programming. Journal of Educational Psychology, 80(3), 291–298. https://doi.org/10.1037/0022-0663.80.3.291
BEBRAS. (2022). Task examples. https://www.bebras.org/examples.html

Boom, K. D., Bower, M., Arguel, A., Siemon, J., & Scholkmann, A. (2018). Relationship between computational thinking and a measure of intelligence as a general problem-solving ability. Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE, 206–211. https://doi.org/10.1145/3197091.3197104
Bundy, A. (2007). Computational thinking is pervasive. Journal of Scientific and Practical Computing, 1(2).
Büyüköztürk, Ş., Çakmak, E. K., Özcan, Ö.E., Karadeniz, Ş. ve Demirel, F. (2016). Scientific research methods (21 st Edition). Ankara: Pegem Academy.
Çakıroğlu, Ü., & Kiliç, S. (2023). Assessing teachers’ PCK to teach computational thinking via robotic programming. Interactive Learning Environments, 31(2), 818–835. https://doi.org/10.1080/10494820.2020.1811734
Chang, C. K. (2014). Effects of using Alice and Scratch in an introductory programming course for corrective instruction. Journal of Educational Computing Research, 51(2), 185–204. https://doi.org/10.2190/EC.51.2.C
Clement, C. A., & Falmagne, R. J. (1986). Logical reasoning, world knowledge, and mental imagery: Interconnections in cognitive processes. Memory & Cognition, 14(4), 299–307. https://doi.org/10.3758/BF03202507/METRICS
Csizmadia, A., Curzon, P., Dorling, M., Humphreys, S., Ng, T., Selby, C., & Woollard, J. (2015). Computational thinking—A guide for teachers.
Curzon, P., Dorling, M., Ng, T., Selby, C., & Woollard, J. (2014). Developing computational thinking in the classroom: A framework.
del Olmo-Muñoz, J., Cózar-Gutiérrez, R., & González-Calero, J. A. (2020). Computational thinking through unplugged activities in early years of Primary Education. Computers & Education, 150, 103832. https://doi.org/10.1016/J.COMPEDU.2020.103832
Erol, O., & Çırak, N. S. (2022). The effect of a programming tool scratch on the problem-solving skills of middle school students. Education and Information Technologies, 27(3), 4065-4086. https://doi.org/10.1007/s10639-021-10776-w
Falkner, K., & Palmer, E. (2009). Developing authentic problem solving skills in introductory computing classes. ACM SIGCSE Bulletin, 41(1), 4–8. https://doi.org/10.1145/1539024.1508871
Garner, S. (2003). Learning resources and tools to aid novices learn programming. 2003 Informing Science + IT Education Conference, 3. https://doi.org/10.28945/2613
Gökoğlu, S., & Kilic, S. (2023). Programming learning and teaching of pre-service computer science teachers: Challenges, concerns, and solutions. E-Learning and Digital Media, 20(5), 498–518. https://doi.org/10.1177/20427530221117331
Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 32(4), 1008–1015. https://doi.org/10.1046/J.1365-2648.2000.T01-1-01567.X
Hoc, J. M., Green, T. R. G., Samurçay, R., & Gilmore, D. (Eds.). (1990). Psychology of programming. Academic Press.
ISTE. (2016). ISTE standarts for students. https://iste.org/standards/students
ISTE & CSTA. (2011). Computational thinking in K–12 education leadership toolkit.
Kalelioğlu, F., Gülbahar, Y., & Kukul, V. (2016). A framework for computational thinking based on a systematic research review. Baltic J. Modern Computing, 4(3), 583–596.
Kılıç, S., & Çakıroğlu, Ü. (2023). Design, implementation, and evaluation of a professional development program for teachers to teach computational thinking via robotics. Technology, Knowledge and Learning, 28(4), 1539–1569. https://doi.org/10.1007/S10758-022-09629-3/METRICS
Kılıç, S., Gökoğlu, S., & Öztürk, M. (2021). A valid and reliable scale for developing programming-oriented computational thinking. Journal of Educational Computing Research, 59(2), 257–286. https://doi.org/10.1177/0735633120964402
Korkmaz, Ö., Çakir, R., & Özden, M. Y. (2017). A validity and reliability study of the computational thinking scales (CTS). Computers in Human Behavior, 72, 558–569. https://doi.org/10.1016/J.CHB.2017.01.005
Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–160. https://doi.org/10.1007/BF02288391
Kuo, W. C., & Hsu, T. C. (2020). Learning computational thinking without a computer: How computational participation happens in a computational thinking board game. Asia-Pacific Education Researcher, 29(1), 67–83. https://doi.org/10.1007/S40299-019-00479-9/FIGURES/8
Kwon, K. (2017). Novice programmer’s misconception of programming reflected on problem-solving plans. International Journal of Computer Science Education in Schools, 1(4), 14–24. https://doi.org/10.21585/IJCSES.V1I4.19
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005). A study of the difficulties of novice programmers. ACM SIGCSE Bulletin, 37(3), 14–18. https://doi.org/10.1145/1151954.1067453
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
Lee, I., Martin, F., Denner, J., Coulter, B., Allan, W., Erickson, J., Malyn-Smith, J., & Werner, L. (2011). Computational thinking for youth in practice. ACM Inroads, 2(1), 32–37. https://doi.org/10.1145/1929887.1929902
Lee, T. Y., Mauriello, M. L., Ahn, J., & Bederson, B. B. (2014). CTArcade: Computational thinking with games in school age children. International Journal of Child-Computer Interaction, 2(1), 26–33. https://doi.org/10.1016/j.ijcci.2014.06.003
Linn, M. C., & Dalbey, J. (1985). Cognitive consequences of programming instruction: Instruction, access, and ability. Educational Psychologist, 20(4), 191–206. https://doi.org/10.1207/s15326985ep2004_4
Lye, S. Y., & Koh, J. H. L. (2014). Review on teaching and learning of computational thinking through programming: What is next for K-12? Computers in Human Behavior, 41, 51–61. https://doi.org/10.1016/J.CHB.2014.09.012
Ma, H., Zhao, M., Wang, H., Wan, X., Cavanaugh, T. W., & Liu, J. (2021). Promoting pupils’ computational thinking skills and self-efficacy: A problem-solving instructional approach. Educational Technology Research and Development, 69(3), 1599–1616. https://doi.org/10.1007/S11423-021-10016-5/TABLES/9
Marinus, E., Powell, Z., Thornton, R., McArthur, G., & Crain, S. (2018). Unravelling the cognition of coding in 3-to-6-year olds: The development of an assessment tool and the relation between coding ability and cognitive compiling of syntax in natural language. ICER 2018 - Proceedings of the 2018 ACM Conference on International Computing Education Research, 18, 133–141. https://doi.org/10.1145/3230977.3230984
Mouza, C., Pan, Y. C., Yang, H., & Pollock, L. (2020). A multiyear investigation of student computational thinking concepts, practices, and perspectives in an after-school computing program. Journal of Educational Computing Research, 58(5), 1029–1056. https://doi.org/10.1177/0735633120905605
Nickerson, R. S. (1983). Computer programming as a vehicle for teaching thinking skills. Thinking: The Journal of Philosophy for Children, 4(3/4), 42–48. https://doi.org/10.5840/THINKING19834310
Nunnally, J. C., & Bernstein, I. R. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
Oliver, R. (1993). Measuring hierarchical levels of programming knowledge. Journal of Educational Computing Research, 9(3), 299–312. https://doi.org/10.2190/0LGX-M45X-2WBK-B7A6
Olsson, J., & Granberg, C. (2022). Teacher-student interaction supporting students’ creative mathematical reasoning during problem solving using Scratch. Mathematical Thinking and Learning, 1-28. https://doi.org/10.1080/10986065.2022.2105567
Papert, S. (1996). An exploration in the space of mathematics educations. International Journal of Computers for Mathematical Learning, 1(1), 95–123. https://doi.org/10.1007/BF00191473/METRICS
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what's being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Rodríguez-Martínez, J. A., González-Calero, J. A., & Sáez-López, J. M. (2020). Computational thinking and mathematics using Scratch: An experiment with sixth-grade students. Interactive Learning Environments, 28(3), 316–327. https://doi.org/10.1080/10494820.2019.1612448
Román-González, M., Pérez-González, J. C., & Jiménez-Fernández, C. (2017). Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test. Computers in Human Behavior, 72, 678–691. https://doi.org/10.1016/J.CHB.2016.08.047
Román-González, M., Pérez-González, J. C., Moreno-León, J., & Robles, G. (2018). Can computational talent be detected? Predictive validity of the Computational Thinking Test. International Journal of Child-Computer Interaction, 18, 47–58. https://doi.org/10.1016/J.IJCCI.2018.06.004
Sajaniemi, J., & Navarro-Prieto, R. (2005). Roles of variables in experts’ programming knowledge. Annual Workshop of the Psychology of Programming Interest Group. https://www.semanticscholar.org/paper/Roles-of-Variables-in-Experts%27-Programming-Sajaniemi-Navarro-Prieto/80c9135a123c0801d393b5a189cec15ee6a315d5
Schneider, G. M., & Gersting, J. (2018). Invitation to computer science. Cengage Learning.
Shen, J., Chen, G., Barth-Cohen, L., Jiang, S., & Eltoukhy, M. (2022). Connecting computational thinking in everyday reasoning and programming for elementary school students. Journal of Research on Technology in Education, 54(2), 205–225. https://doi.org/10.1080/15391523.2020.1834474
Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017). Demystifying computational thinking. Educational Research Review, 22, 142–158. https://doi.org/10.1016/J.EDUREV.2017.09.003
Sun, L., Hu, L., & Zhou, D. (2022). Programming attitudes predict computational thinking: Analysis of differences in gender and programming experience. Computers & Education, 181, 104457. https://doi.org/10.1016/J.COMPEDU.2022.104457
Swaid, S. I. (2015). Bringing computational thinking to STEM education. Procedia Manufacturing, 3, 3657–3662. https://doi.org/10.1016/J.PROMFG.2015.07.761
Tang, X., Yin, Y., Lin, Q., Hadad, R., & Zhai, X. (2020). Assessing computational thinking: A systematic review of empirical studies. Computers & Education, 148, 103798. https://doi.org/10.1016/J.COMPEDU.2019.103798
Tom, M. (2015). Five CS framework: A student-centered approach for teaching programming courses to students with diverse disciplinary background. Journal of Learning Design, 8(1), 21–37. https://doi.org/10.5204/JLD.V8I1.193
Üçgül, M. (2022). Educational robots and computational thinking. In Y. Gülbahar (Ed.), From computational thinking to programming (5th ed., pp. 295–318). Pegem Akademi.
Wang, X. C., Choi, Y., Benson, K., Eggleston, C., & Weber, D. (2021). Teacher’s role in fostering preschoolers’ computational thinking: An exploratory case study. Early Education and Development, 32(1), 26–48. https://doi.org/10.1080/10409289.2020.1759012
Weinberg, A. E. (2013). Computational thinking: An investigation of the existing scholarship and research [Doctoral dissertation]. Colorado State University.
Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33–35. https://doi.org/10.1145/1118178.1118215
Wu, S. Y., & Su, Y. S. (2021). Visual programming environments and computational thinking performance of fifth- and sixth-grade students. Journal of Educational Computing Research, 59(6), 1075–1092. https://doi.org/10.1177/0735633120988807
Yadav, A., Krist, C., Good, J., & Caeli, E. N. (2018). Computational thinking in elementary classrooms: Measuring teacher understanding of computational ideas for teaching science. Computer Science Education, 28(4), 371–400. https://doi.org/10.1080/08993408.2018.1560550
Yadav, A., Stephenson, C., & Hong, H. (2017). Computational thinking for teacher education. Communications of the ACM, 60(4), 55–62. https://doi.org/10.1145/2994591
Yükseltürk, E., & Altıok, S. (2022). Block-based programming. In Y. Gülbahar (Ed.), From computational thinking to programming (pp. 241–266). Pegem Academy.
Zhang, L. C., & Nouri, J. (2019). A systematic review of learning computational thinking through Scratch in K-9. Computers & Education, 141, 103607. https://doi.org/10.1016/J.COMPEDU.2019.103607

Details

Primary Language

English

Subjects

Higher Education Studies (Other)

Journal Section

Research Article

Authors

Servet Kılıç ^*
0000-0002-1687-3231
Türkiye

Seyfullah Gökoğlu
0000-0003-0074-7692
Türkiye

Publication Date

May 4, 2026

Submission Date

January 9, 2026

Acceptance Date

February 11, 2026

Published in Issue

Year 2026 Volume: 13 Number: 3

DOI

https://doi.org/10.17275/per.26.37.13.3

IZ

https://izlik.org/JA53MD54TB

APA

Kılıç, S., & Gökoğlu, S. (2026). The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning. Participatory Educational Research, 13(3), 119-141. https://doi.org/10.17275/per.26.37.13.3

AMA

1.Kılıç S, Gökoğlu S. The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning. PER. 2026;13(3):119-141. doi:10.17275/per.26.37.13.3

Chicago

Kılıç, Servet, and Seyfullah Gökoğlu. 2026. “The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning”. Participatory Educational Research 13 (3): 119-41. https://doi.org/10.17275/per.26.37.13.3.

EndNote

Kılıç S, Gökoğlu S (May 1, 2026) The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning. Participatory Educational Research 13 3 119–141.

IEEE

[1]S. Kılıç and S. Gökoğlu, “The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning”, PER, vol. 13, no. 3, pp. 119–141, May 2026, doi: 10.17275/per.26.37.13.3.

ISNAD

Kılıç, Servet - Gökoğlu, Seyfullah. “The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning”. Participatory Educational Research 13/3 (May 1, 2026): 119-141. https://doi.org/10.17275/per.26.37.13.3.

JAMA

1.Kılıç S, Gökoğlu S. The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning. PER. 2026;13:119–141.

MLA

Kılıç, Servet, and Seyfullah Gökoğlu. “The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning”. Participatory Educational Research, vol. 13, no. 3, May 2026, pp. 119-41, doi:10.17275/per.26.37.13.3.

Vancouver

1.Servet Kılıç, Seyfullah Gökoğlu. The Effect of Problem-Solving-Based Programming Training on Computational Thinking Skills in the Context of Programming and Reasoning. PER. 2026 May 1;13(3):119-41. doi:10.17275/per.26.37.13.3