The Effect Of Using E-Portfolios On The Self-Regulation Skills Of Students: A Meta-Analysis Study

Abstract

The change of self-regulation skills, one of the variables determining success in education, with measurement and evaluation techniques in the education process has been the subject of many studies. However, each research result leads to different results due to the planned situation and limitations. For this reason, e-portfolios used in the education process were examined with a meta-analysis study to evaluate whether they were effective on students' self-regulation skills from a more general point of view. The research is limited to published academic studies written in Turkish and English between 2000 and 2023. When the criteria determined in the research were examined, only 19 studies were found by these criteria. Theoretically, when the effect sizes in each study were examined, a meta-analysis was carried out with the random effects model. The analyzes of the research were made with the CMA version 3 program. As a result of the research, it was concluded that using e-portfolios greatly and significantly affect students' self-regulation skills.

Keywords

• e-portfolio
• self-regulation
• meta-analysis
• random effects model.

References

1. Abrami, P. C., Venkatesh, V., Meyer, E. J., & Wade, C. A. (2013). Using electronic portfolios to foster literacy and self-regulated learning skills in elementary students. Journal of Educational Psychology, 105(4), 1188. https://doi.org/10.1037/a0032448
2. Akgün, E., & Kölemen, C. Ş. (2020). E-portfolyo oluşturmanin öğrencinin akademik öz düzenleme becerisine etkisi. Milli Eğitim Dergisi, 49(227), 117-140.
3. Alexiou, A., & Paraskeva, F. (2013). Exploiting motivation and self-efficacy through the implementation of self-regulated oriented ePortfolio. In International Conference on E-Learning in the Workplace, NY, USA.
4. Alexiou, A., & Paraskeva, F. (2014). Implementing a Self-Regulated Oriented ePortfolio: The Design of an Affective Goal-Setting Plugin. In 2014 IEEE 14th International Conference on Advanced Learning Technologies (pp. 474-476). IEEE. http://doi.org/ 10.1109/ICALT.2014.140
5. Alexiou, A., & Paraskeva, F. (2019). Examining self-regulated learning through a social networking ePortfolio in higher education. International Journal of Learning Technology, 14(2), 162-192. https://doi.org/10.1504/IJLT.2019.101849
6. Alhitty, A., & Shatnawi, S. (2021). Using E-portfolios for Writing to Promote Students' Self-Regulation. In Proceedings of the AUBH E-Learning Conference.
7. Barış, M. F. ve Tosun, N. (2013). Sosyal ağ ve e-portfolyo entegrasyonu: Facebook Örneği. Eğitim ve Öğretim Araştırmaları Dergisi, 2(2), 122-129.
8. Barrett, H. (2006). Using electronic portfolios for classroom assessment. Connected Newsletter, 14(2), 4-6.

9. Bartlett, A., & Sherry, A. (2006). Tow views of electronic portfolios in teacher education: Non-tech- nology undergraduates and technology graduate students. International Journal of Instructional Media, 33(3), 245–253.
10. Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2010). A basic introduction to fixed‐effect and random‐effects models for meta‐analysis. Research synthesis methods, 1(2), 97-111. https://doi.org/10.1002/jrsm.12
11. Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2021). Introduction to meta-analysis. John Wiley & Sons.
12. Campbell, M. I., & Schmidt, K. J. (2005). Polaris: An undergraduate online portfolio system that encourages personal reflection and career planning. International Journal of Engineering Education, 21(5), 931-942.
13. Cheng, G., & Chau, J. (2013). Exploring the relationship between students' self-regulated learning ability and their ePortfolio achievement. The Internet and Higher Education, 17, 9-15. https://doi.org/10.1016/j.iheduc.2012.09.005
14. Chang, C. C., Liang, C., Chou, P. N., & Liao, Y. M. (2018). Using e-portfolio for learning goal setting to facilitate self-regulated learning of high school students. Behaviour & Information Technology, 37(12), 1237-1251. https://doi.org/10.1080/0144929X.2018.1496275
15. Chou, C. M. (2012). Influence of teachers' perceived e-portfolio acceptance on teacher evaluation effectiveness in Taiwan. Australasian Journal of Educational Technology, 28(4). https://doi.org/10.14742/ajet.1382
16. Cooney, F. E. (2007). Adolescent self-regulation skills, working portfolios, and explicit instruction: A mixed methods study (Doctoral dissertation, Walden University).
17. Corta, D. (2019). Use of an e-portfolio to increase academic self-regulation in an undergraduate academic research course. (Unpublished doctoral thesis, Private University in Peru).
18. Demirli, C. (2007). Elektronik portfolyo öğretim sürecinin öğrenen tutumlarına ve öğrenme algılarına etkisi. (Yayımlanmamış doktora tezi, Fırat Üniversitesi Sosyal Bilimler Enstitüsü, Elazığ).
19. Demirli, C., & Gurol, M. (2010, March). Teacher candidates’ attitudes and perceptions towards electronic portfolio process. In Society for Information Technology & Teacher Education International Conference (pp. 1412-1417). Association for the Advancement of Computing in Education (AACE).
20. Dent, A. L., & Koenka, A. C. (2016). The relation between self-regulated learning and academic achievement across childhood and adolescence: A meta-analysis. Educational Psychology Review, 28(3), 425-474. http://doi.org/10.1007/s10648-015-9320-8
21. Ekbatani, G., & Pierson, H. (2000). Learner-directed assessment in ESL.Mahwah, NJ: Erlbaum.
22. Eom, W. (1999). The effects of self-regulated learning strategy on academic achievement in a computer networked hypertext/hypermedia learning environment (Unpublished doctoral dissertation). Florida State University, Florida.
23. Eom, W., & Reiser, R. A. (2000). The effects of self-regulation and instructional control on performance and motivation in computer-based instruction. International Journal of Instructional Media, 27(3), 247.
24. Field, A. P., & Gillett, R. (2010). How to do a meta‐analysis. British Journal of Mathematical and Statistical Psychology, 63(3), 665-694. https://doi.org/10.1348/000711010X502733
25. Jenson, J. D., & Treuer, P. (2014). Defining the E-Portfolio: What it is and why it matters. Change: The Magazine of Higher Learning, 46(2), 50-57. https://doi.org/10.1080/00091383.2014.897192
26. Ghosh, R. (2003). Development and evaluation of a portfolio assessment package for year fve local studies [Unpublished doctoral thesis]. University of Malaya, Kuala Lumpur, Malaysia. http://studentsrepo. um.edu.my/3050/
27. Glass, G. V. (1976). Primary, secondary and meta-analysis of research. Educational Researcher, 5, 3–8.
28. Gozuyesil, E., & Tanriseven, I. (2017). A meta-analysis of the effectiveness of alternative assessment techniques. Eurasian Journal of Educational Research, 17(70), 37-56. http://dx.doi.org/10.14689/ejer.2017.70.3
29. Gülbahar, Y. ve Köse, F. (2006). Öğretmen adaylarının değerlendirme için elektronik portfolyo kullanımına ilişkin görüşleri. Ankara Üniversitesi Eğitim Bilimleri Fakültesi Dergisi, 39(2), 75-93.
30. Hanji, M. B. (2017). Meta-analysis in psychiatry research: Fundamental and advanced methods. CRC Press.
31. Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2022). Doing meta-analysis with R: A hands-on guide. CRC Press.
32. Hedges, L. V. (1982). Estimation of effect size from a series of independent experiments. Psychological Bulletin, 92(2), 490–499. https://doi.org/10.1037/0033-2909.92.2.490.
33. Hedges, L. V. (1992). Meta-analysis. Journal of Educational Statistics, 17(4), 279-296.
34. Hedges, L. V., & Vevea, J. L. (1998). Fixed-and random-effects models in meta-analysis. Psychological methods, 3(4), 486.
35. Karami, S., Sadighi, F., Bagheri, M. S., & Riasati, M. J. (2019). The Impact of Application of Electronic Portfolio on Undergraduate English Majors' Writing Proficiency and Their Self-Regulated Learning. International Journal of Instruction, 12(1), 1319-1334.
36. Kinash, S., Wood, K., & McLean, M. (2012). The whys and why nots of e-portfolios. Learning and teaching papers. http://epublications.bond. edu.au/tls/44.
37. Koç, A. (2010). Bilgisayar okuryazarlığı becerisi ediniminde e-portfolyo sürecinin öğrenen performansına ve tutumlarına etkisi. (Yayımlanmamış doktora tezi, Fırat Üniversitesi Sosyal Bilimler Enstitüsü, Elazığ).
38. Liang, C., Chang, C. C., Shu, K. M., Tseng, J. S., & Lin, C. Y. (2016). Online reflective writing mechanisms and its effects on self-regulated learning: A case of web-based portfolio assessment system. Interactive Learning Environments, 24(7), 1647-1664. https://doi.org/10.1080/10494820.2015.1041403
39. Lorenzo, G., & Ittelson, J. (2005). An overview of e-portfolios. Educause Learning Initiative, Paper 1:2005. http://electronicportfolio.pbworks. com/f/reading04overview.pdf.
40. Lysenko, L., Wade, C. A., Abrami, P. C., Iminza, R., & Kiforo, E. (2022). Self-Regulated Learning in Kenyan Classrooms: A Test of ePEARL, a Process e-Portfolio. International Journal of Instruction, 15(3), 63-82.
41. Meyer, E., Abrami, P. C., Wade, C. A., Aslan, O., & Deault, L. (2010). Improving literacy and metacognition with electronic portfolios: Teaching and learning with ePEARL. Computers & Education, 55(1), 84-9. https://doi.org/10.1016/j.compedu.2009.12.005
42. Mutluer, C. (2022). Tamamlayıcı Ölçme ve Değerlendirme Tekniklerinin Akademik Başarıya Etkisi: Bir Meta-Analiz Çalışması. Ankara Üniversitesi Sosyal Bilimler Dergisi, 13(1), 15-27. http://doi.org/ 10.33537/sobild.2022.13.1.2
43. Nguyen, L. T., & Ikeda, M. (2015). The effects of ePortfolio-based learning model on student self-regulated learning. Active Learning in Higher Education, 16(3), 197-209. https://doi.org/10.1177/1469787415589532 Pintrich, P. R., & DeGroot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82, 33–40. http://doi.org/10.1037/0022-0663.82.1.33.
44. Polat, M. ve Köse, Y. (2013). Okullarda bir performans değerlendirme aracı olarak e-portfolyo kullanımına yönelik ilköğretim öğretmenlerinin görüşleri. Bilgisayar ve Eğitim Araştırmaları Dergisi, 1(1), 57-82.
45. Railean, E. (2008). Electronic textbooks in electronic portfolio: a new approach for the self regulated learning. In Proceedings of 9th International Conference on Development and Application Systems (pp. 138-141).
46. Romero, L., Saucedo, C., Caliusco, M. L., & Gutiérrez, M. (2019). Supporting self-regulated learning and personalization using ePortfolios: a semantic approach based on learning paths. International Journal of Educational Technology in Higher Education, 16, 1-16. http://doi.org/ 10.1186/s41239-019-0146-1
47. Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005). Publication bias in meta-analysis. Publication bias in meta-analysis: Prevention, assessment and adjustments, 1-7. http://doi.org/ 10.1002/0470870168
48. Sasai, L. (2017). Self-regulated learning and the use of online portfolios: A social cognitive perspective. Journal of Educational and Social Research, 7(2), 55.
49. Srinivasjois, R. (2021). Fixed and random-effects models for meta-analysis. In Principles and practice of systematic reviews and meta-analysis (pp. 73-78). Cham: Springer International Publishing.
50. Sterne, J. A., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Higgins, J. P. T. (2011). Recommendations for examining and ınterpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 343, 1-8. https://doi.org/10.1136/bmj.d4002
51. Şen, S. & Yıldırım, İ. (2020). CMA ile meta-analiz uygulamaları. Anı. Thalheimer, W., & Cook, S. (2002). How To Calculate Effect Sizes from Published Research: A Simplified Methodology. Work-Learning Research, 1, 1-9.
52. Trainin, G., & Swanson, H. L. (2005). Cognition, metacognition, and achievement of college students with learning disabilities. Learning Disability Quarterly, 28(4), 261-272.
53. Tseng, K. H., & Lin, C. Y. (2015). Does using e-portfolios for reflective writing enhance high school students’ self-regulated learning?. Technology, Pedagogy and Education, 25(3), 317-336. https://doi.org/10.1080/1475939X.2015.1042907
54. Türkkaynağı, U. (2021). Investigating the use of speaking E-Portfolios in an EFL context and its effects on students’ perceived speaking self-efficacy (Master's thesis, Pamukkale Üniversitesi Eğitim Bilimleri Enstitüsü).
55. Üredi, İ., & Üredi, L. (2005). İlköğretim 8. sınıf öğrencilerinin öz-düzenleme stratejileri ve motivasyonel inançlarının matematik başarısını yordama gücü. Mersin Üniversitesi Eğitim Fakültesi Dergisi, 1(2), 250-260.
56. Van Der Gulden, R., Heeneman, S., Kramer, A. W. M., Laan, R. F. J. M., Scherpbier-de Haan, N. D., & Thoonen, B. P. A. (2020). How is self-regulated learning documented in e-portfolios of trainees? A content analysis. BMC medical education, 20(1), 1-13. http://doi.org /10.1186/s12909-020-02114-4
57. Van Wesel, M., & Prop, A. (2009). Comparing students’ perceptions of paper-based and electronic portfolios. Canadian Journal of Learning and Technology/La revue canadienne de l’apprentissage et de la technologie, 34(3).
58. Wanchid, R., & Charoensuk, V. (2015). The Effects of Paper-Based Portfolios and Weblog-Based Electronic Portfolios on Limited English Proficiency Students in Writing for Service Industry Course. English Language Teaching, 8(9), 131-145. http://doi.org/ :10.5539/elt.v8n9p131
59. Zimmerman, B. J. (1986). Becoming a self-regulated learner: which are the key subprocesses? Contemporary Educational Psychology, 11, 307–313.
60. Zimmerman, B. J. (1989). A social cognitive view of self-regulated academic learning. Journal of Educational Psychology, 81, 329–33.