The impact of peer feedback on collaborative problem-solving skills in the online environment

Abstract

The aim of this study is to investigate the impact of online peer feedback in the Information Technologies and Software course on the improvement of collaborative problem-solving skills (CPS), which are considered essential skills for the 21st century. The impact of peer feedback on CPS was designed using a mixed-methods approach that combines quantitative and qualitative data in the research. The study employed a set of CPS tasks that were specifically designed to measure the target behaviors outlined in the 6th-grade Information Technologies and Software course curriculum. Additionally, the study made use of various instruments, including a peer feedback survey, a longitudinal rating scale for tracking the development of CPS, and a peer feedback interview protocol. As a result, a statistically significant difference was found between the CPS of the experimental and control groups. According to the results of the study, it can be expressed that the CPS and peer feedback skills of the students in the experimental group have improved and that they have a more positive attitude toward giving peer feedback and solving collaborative problems based on the results of the interview form.

Keywords

• Collaborative problem solving
• Peer feedback
• 21st-century skills
• Collaborative learning
• Information technologies and software

References

1. Açıkgöz, K. (1990). İşbirliğine dayalı öğrenme ve geleneksel öğretimin üniversite öğrencilerinin akademik başarısı, hatırda tutma düzeyleri ve duyuşsal özellikleri üzerindeki etkileri [The effects of cooperative learning and traditional teaching on academic achievement, retention levels and affective characteristics of university students]. A.Ü. Eğitim Bilimleri Fakültesi: I. Ulusal Eğitim Bilimleri Kongresi. Ankara.
2. Andrews-Todd, J., Fiore, S.M., Foltz, P.W., Graesser, A.C., Greiff, S., & Hesse, F.W. (2018). Advancing the science of collaborative problem solving. Psychological Science in the Public Interest, 19(2), 59-92. https://doi.org/10.1177/1529100618808244
3. Anwar, D., Rozimela, Y., & Suryani, R.W. (2019). Exploring the effect of peer feedback and the students’ perceptions of the feedback on students writing skill. International Journal of Secondary Education, 7(4), 116. https://doi.org/10.11648/j.ijsedu.20190704.14
4. Arıcı, Ö. (2019). Türk öğrencilerin PISA 2015 sonuçlarına göre aracılık modelleriyle işbirlikçi problem çözme becerilerine ilişkin faktörlerin incelenmesi [Investigation of factors related to Turkish students' collaborative problem solving skills with mediation models according to PISA 2015 results] [Unpublished master’s thesis]. Ankara Üniversitesi, Ankara, Türkiye.
5. Ashman, A.F., & Gillies, R.M. (2003). Co-operative learning. Psychology Press.
6. Atar, H.Y., & Yavuz, E. (2020). An examination of Turkish students’ PISA 2015 collaborative problem-solving competencies. International Journal of Assessment Tools in Education, 7(4), 588-606. https://doi.org/10.21449/ijate.682103
7. Aydın, F. (2020). 7. sınıf öğrencilerinin matematik dersinde işbirlikli problem çözme becerilerinin gelişiminin izlenmesinde kullanılabilecek boylamsal bir test deseni [A longitudinal test design for monitoring the development of 7th grade students’ collaborative problem solving skills in mathematics course] [Unpublished master’s thesis]. Gazi Üniversitesi, Ankara, Türkiye.
8. Barron, B. (2000). Achieving coordination in collaborative problem-solving groups. The Journal of The Learning Sciences, 9(4), 403 436. https://doi.org/10.1207/S15327809JLS0904_2

9. Bayat, A., Biemans, H.J., Ginkel, S., Hatami, J., Mulder, M., & Noroozi, O. (2020). Students online argumentative peer feedback, essay writing, and content learning: Does gender matter?. Interactive Learning Environments, 28(6), 698 712. https://doi.org/10.1080/10494820.2018.1543200
10. Baykara, K. (2000). İşbirliğine dayalı öğrenme teknikleri ve denetim odakları üzerine bir çalışma [A study on collaborative learning techniques and locus of control] [Unpublished master’s thesis]. Hacettepe Üniversitesi, Ankara, Türkiye.
11. Berggren, J. (2015). Learning from giving feedback: A study of secondary-level students. ELT Journal, 69(1), 58-70. https://doi.org/10.1093/elt/ccu036
12. Bijami, M., Kashef, S.H., & Nejad, M.S. (2013). Peer feedback in learning English writing: Advantages and disadvantages. Journal of Studies in Education, 3(4), 91 97. https://doi.org/10.5296/jse.v3i4.4314
13. Bonner, B.L., Laughlin, P.R., & Miner, A.G. (2002). Groups perform better than individuals on letters-to-numbers problems. Organisational Behaviour and Human Decision Processes, 88, 605–620. https://doi.org/10.1016/S0749-5978(02)00003-1
14. Bulu, S.T., & Pedersen, S. (2012). Supporting problem-solving performance in a hypermedia learning environment: The role of students prior knowledge and metacognitive skills. Computers in Human Behavior, 28(4), 1162 1169. https://doi.org/10.1016/j.chb.2012.01.026
15. Büyüköztürk, Ş. (2005). Anket geliştirme [Survey development]. The Journal of Turkish Educational Sciences, 3(2), 133 151. https://dergipark.org.tr/en/pub/tebd/issue/26124/275190
16. Cansoy, R. (2018). Uluslararası çerçevelere göre 21. yüzyıl becerileri ve eğitim sisteminde kazandırılması [21st century skills according to ınternational frameworks and their acquisition in the education system]. Journal of Human and Social Sciences Research, 7(4), 3112-3134. https://orcid.org/0000-0003-2768-9939
17. Care, E., & Griffin, P. (2012). A framework for teachable collaborative problem solving skills. In J. Buder, E. Care, P. Griffin, F. Hesse, & K. Sassenberg (Eds.), Assessment and Teaching of 21st Century Skills (pp. 37-56). Springer.
18. Carless, D., & Liu, N.F. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279 290. https://doi.org/10.1080/13562510600680582
19. Carnell, E. (2000). Dialogue, discussion and secondary school students on how others help their learning. In S. Askew (Ed.). Feedback for learning (pp. 46-61). Routledge.
20. Clark, V.L.P., & Creswell, J.W. (2017). Designing and conducting mixed methods research. Sage publications.
21. Clewley, D., Dowell, N., & Graesser, A.C. (2017). Assessing collaborative problem solving through conversational agents. In Innovative assessment of collaboration. Springer.
22. Csapo, B., & Funke, J. (2017). Educational research and innovation the nature of problem solving using research to inspire 21st century learning: Using research to inspire 21st century learning. OECD Publishingcare.
23. Cuevas, H.M., Fiore, S.M., Scielzo, S., & Salas, E. (2002). Training individuals for distributed teams: Problem solving assessment for distributed mission research. Computers in Human Behavior, 18(6), 729-744. https://doi.org/10.1016/S0747-5632(02)00027-4
24. Çevik, Y.D. (2014). Dönüt alan mı memnun veren mi? Çevrimiçi akran dönütü ile ilgili öğrenci görüşleri [Is the receiver or the giver of feedback satisfied? Student views on online peer feedback]. Journal of Instructional Technologies and Teacher Education, 3(1), 10-23. https://dergipark.org.tr/en/pub/jitte/issue/25083/264720
25. Dochy, F., Gielen, S., Onghena, P., Peeters, E., & Struyven, K. (2010). Improving the effectiveness of peer feedback for learning. Learning and Instruction, 20(4), 304–315. https://doi.org/10.1016/j.learninstruc.2009.08.007
26. Er, E., Dimitriadis, Y., & Gašević, D. (2020). Collaborative peer feedback and learning analytics: theory-oriented design for supporting class-wide interventions. Assessment & Evaluation in Higher Education, 46(2), 169 190. https://doi.org/10.1080/02602938.2020.1764490
27. Falchikov, N. (2005). Improving assessment through student ınvolvement: Practical solutions for aiding learning in higher and further education. Routledge.
28. Fiore, S.M., Graesser, A., Greiff, S., Griffin, P., Gong, B., Kyllonen, P., & von Davier, A. (2017). In S. Fiore (Ed.). Collaborative problem solving: Considerations for the national assessment of educational progress. National Center for Education Statistics.
29. Flood, J., & Lapp, D. (1989). Cooperative problem solving: Enhancing learning in the secondary science classroom. The American Biology Teacher, 51(2), 112 115. https://doi.org/10.2307/4448864
30. Gardunio, E.L.H. (2001). The influence of cooperative problem solving on gender differences in achievement, self-efficacy, and attitudes toward mathematics in gifted students. Gifted Child Quarterly, 45(4), 268-282. https://doi.org/10.1177/001698620104500405
31. Ge, X., & Land, S.M. (2003). Scaffolding students’ problem-solving processes in an illstructured task using question prompts and peer interactions. Educational Technology Research and Development, 51(1), 21–38. https://doi.org/10.1007/BF02504515
32. Genç, M. (2007). İşbirlikli öğrenmenin problem çözmeye ve başarıya etkisi [The effect of cooperative learning on problem solving and achievement] [Unpublished doctoral thesis]. Marmara University.
33. Gök, T. (2006). Fizik eğitiminde işbirlikli öğrenme gruplarında problem çözme stratejilerinin öğrenci başarısı, başarı güdüsü ve tutumu üzerindeki etkileri [The effects of problem solving strategies on student achievement, achievement motivation and attitude in cooperative learning groups in physics education] [Unpublished doctoral thesis]. Dokuz Eylul University.
34. Gijbels, D., Segers, M.S.R., & Thurlings, M. (2008). The relationship between students’ perceptions of portfolio assessment practice and their approaches to learning. Educational Studies, 34(1), 35-44. https://doi.org/10.1080/03055690701785269
35. Gu, X., Chen, S., Lin, L., & Zhu, W. (2015). An intervention framework designed to develop the collaborative problem-solving skills of primary school students. Educational Technology Research and Development, 63(1), 143-159. https://doi.org/10.1007/s11423-014-9365-2
36. Heller, K., & Heller, P. (2010). Cooperative problem solving in physics a user’s manual. https://www.aapt.org/conferences/newfaculty/upload/coop-problem-solving-guide.pdf
37. Hogan, D.M., Tudge, J.R., & Winterhoff, P.A. (1996). The cognitive consequences of collaborative problem solving with and without feedback. Child Development, 67(6), 2892-2909. https://doi.org/10.1111/j.1467-8624.1996.tb01894.x
38. Huber, G.L., & Huber, A.A. (2008). Structuring group interaction to promote thinking and learning during small group learning in high school settings (pp. 110-131). Springer.
39. James, R.H., & Johnston, C.G. (1996). An evaluation of the effectivess of collaborative problem-solving for learning economics (No.534). The University of Melbourne: Melbourne.
40. Jennings, N.R., & Wooldridge, M. (1999). The cooperative problem-solving process. Journal of Logic and Computation, 9(4), 563-592. https://doi.org/10.1093/logcom/9.4.563
41. Karakuş G. (2020). İşbirlikli problem çözme öğretim programı tasarısının hazırlanması ve uygulanması [Preparation and ımplementation of cooperative problem solving curriculum design] [Unpublished doctoral thesis]. Afyon Kocatepe University.
42. Karasar, N. (2018). Bilimsel Araştırma Yöntemi [Scientific Research Method] (33. Edition). Nobel Yayıncılık.
43. Kilic, S. (2014). Effect size. Journal of Mood Disorders, 4(1), 44 46. https://doi.org/10.5455/jmood.20140228012836
44. Kittur, A., Kraut, R.E., & Tausczik, Y.R. (2014, February). Collaborative problem solving: A study of mathoverflow. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing, USA.
45. Kneivel, E.M., Laughlin, P.R., Tan, T.K., & Zander, M.L. (2003). Groups perform better than the best individuals on the letters-to-numbers problems: Informative equations and effective strategies. Journal of Personality and Social Psychology, 85, 684–694. https://doi.org/10.1037/0022-3514.85.4.684
46. Macfarlane-Dick, D., & Nicol, D.J. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. https://doi.org/10.1080/03075070600572090
47. Molnár, G., Pásztor-Kovács, A., & Pásztor, A. (2021). Measuring collaborative problem solving: research agenda and assessment instrument. Interactive Learning Environments, 1(21). https://doi.org/10.1080/10494820.2021.1999273
48. Nelson, L.M. (1998). Collaborative problem-solving: An instructional theory for learning through small group interaction (pp. 1-143). ProQuest Dissertations Publishing.
49. Nilson, L.B. (2003). Improving student peer feedback. College Teaching, 51(1), 34-38. https://doi.org/10.1080/87567550309596408
50. O'Dowd, R., & Ware, P. (2008). Peer feedback on language form in telecollaboration. Language Learning & Technology, 12(1), 43 63. https://llt.msu.edu/vol12num1/wareodowd/
51. OECD (2013). PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. OECD publishing.
52. Özşavli, M. (2017). Akran geri bildiriminin Türkçeyi yabancı dil olarak öğrenen öğrencilerin yazma becerisine etkisi [The effect of peer feedback on the writing skills of students learning Turkish as a foreign language] [Unpublished master’s thesis]. Mustafa Kemal University.
53. Patri, M. (2002). The influence of peer feedback on self-and peer-assessment of oral skills. Language Testing, 19(2), 109-131. https://doi.org/10.1191/0265532202lt224oa
54. Roschelle, J., & Teasley, S.D. (1995). The construction of shared knowledge in collaborative problem solving. In E. Lehtinen (Ed.). Computer Supported Collaborative Learning (pp. 69-97). Springer.
55. Rummel, N., & Spada, H. (2005). Learning to collaborate: An instructional approach to promoting collaborative problem solving in computer-mediated settings. The journal of the Learning Sciences, 14(2), 201-241. https://doi.org/10.1207/s15327809jls1402_2
56. Schwartz, D.L. (1995). The emergence of abstract representations in dyad problem solving. The Journal of the Learning Sciences, 4, 321 354. https://doi.org/10.1207/s15327809jls0403_3
57. Smith, K., & Tillema, H.H. (2000). Learning from portfolios: Differential use of feedback in portfolio construction. Studies in Educational Evaluation, 26(3), 193 210. https://doi.org/10.1016/S0191-491X(00)00015-8
58. Temizkan, M. (2009). Akran değerlendirmenin konuşma becerisinin geliştirilmesi üzerindeki etkisi [The effect of peer review on the development of speaking skills]. Journal of Mustafa Kemal University Institute of Social Sciences, 6(12), 90 112. https://dergipark.org.tr/en/pub/mkusbed/issue/19557/208435
59. Türk Sanayicileri ve İşadamları Derneği, TUSIAD (2019). Sosyal ve Duygusal Öğrenme Becerileri Raporu. (TÜSİAD T/2019 11/609). https://tusiad.org/tr/yayinlar/raporlar/item/10450-sosyal-ve-duygusal-ogrenme-becerileri
60. Türkeş Yazıcı, A. (2022). Ortaokul 6. sınıf öğrencilerinin iş birlikli problem çözme becerilerinin incelenmesi [Examination of cooperative problem solving skills of middle school 6th grade students] [Unpublished master’s thesis]. Adnan Menderes University.
61. Ur, P. (1996). Discussions that work: Task-centred fluency practice. Cambridge University Press.
62. Uysal, G. (2010). İlköğretim sosyal bilgiler dersinde işbirlikli öğrenmenin erişiye, problem çözme becerilerine, öğrenme stillerine etkisi ve öğrenci görüşleri [The effect of cooperative learning on achievement, problem solving skills, learning styles in elementary social studies course and students' opinions] [Unpublished doctoral thesis]. Dokuz Eylul University.
63. Uzunosmanoğlu, S.D. (2013). Examining computer supported collaborative problem solving processes using the dual-eye tracking paradigm [Unpublished master’s thesis]. Middle East Technical University.
64. Wegerif, R. (2006). A dialogic understanding of the relationship between CSCL and teaching thinking skills. International Journal of Computer-Supported Collaborative Learning, 1(1), 143-157. https://doi.org/10.1007/s11412-006-6840-8
65. World Economic Forum. (2015). New vision for education: Unlocking the potential of technology. Vancouver, BC: British Columbia Teachers' Federation.
66. World Economic Forum Boston Consulting Group (BCG). (2018). Towards a reskilling revolution: A future of jobs for all. World Economic Forum, Geneva, Switzerland.