Reflections of the Applied Research Methods Course on Graduate (Master's) Students' Performance: A Methodological Evaluation

Soner Mehmet Özdemir; Belgin Bal İncebacak; Şadiye Karaşah Çakıcı; Hilal Demirel

doi:10.17275/per.26.39.13.3

Reflections of the Applied Research Methods Course on Graduate (Master's) Students' Performance: A Methodological Evaluation

Abstract

This study aims to evaluate the methodology sections of draft articles prepared by master's students participating in the TÜBİTAK (The Scientific and Technological Research Council of Türkiye) 2237 project titled "Research Methods Training II for Graduate (master's) Students' Studying in the Field of Educational Sciences" in four groups during the course period, based on expert opinions. The study employed a qualitative research model, with participants comprising 21 graduate students' who attended the relevant course in June 2024. The data were collected through rubrics based on observations and document analysis and were analyzed using content analysis. According to the findings, the majority of participants rated themselves below average in research methods prior to the course. In addition, the majority of participants again stated that their level of competence in independently writing the methods section of a study was quite low. At the end of the training, it was observed that the participants' knowledge, skills, and competence in research methods had increased significantly compared to their pre-course levels. The review and evaluation revealed that the methods sections of the draft articles prepared by the groups were generally adequate but needed improvement in some areas. It was determined that the participants' work was generally appropriate in terms of method or design selection, and that the procedures and explanations regarding data collection tools, data analysis, validity, and reliability were sufficient. However, some deficiencies or errors were identified in terms of sample determination and the selection of appropriate statistical techniques.

Keywords

Graduate education, Master's students, method, scientific research

Supporting Institution

This research was funded by the Scientific and Technological Research Council of Türkiye (TÜBİTAK).

Project Number

1129B372400524

Ethical Statement

The study was approved by the relevant ethics committee (Ethics Committee Approval Number and Date can be added). All procedures followed the ethical standards of TÜBİTAK’s Research and Publication Ethics Guidelines and general social sciences research ethics. To ensure confidentiality, all participant data were anonymized.

Thanks

We sincerely thank TÜBİTAK for its support for the project. We would also like to sincerely thank all volunteers who participated in the study and contributed to the data collection process.

References

Akbaş, O., Duman, S.M., & Keskin, A. (2021). A study on curriculum leadership competencies. Turkish Journal of Primary Education, 6(2), 157-179. https://doi.org/10.52797/tujped.1014824
Akgün, Ö. E., & Güntaş, S. (2018). An examination of graduate students' scientific research competencies based on advisor opinions: The case of the Turkish Republic of Northern Cyprus. Sakarya University Journal of Education, 8(2), 131–144. https://doi.org/10.19126/suje.365103
Akyürek, E., & Afacan, Ö. (2018). Problems encountered during the scientific research process in graduate education: The Institute of Educational Sciences. Higher Education Studies, 8(2), 47-57. https://doi.org/10.5539/hes.v8n2p47
Altıok, S., Yükseltürk, E., & Üçgül, M. (2018). An examination of graduate students' scientific research competencies and research-related anxieties in terms of various variables. Journal of Higher Education and Science, (2), 348-367. https://izlik.org/JA57HX43KP
American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.). https://doi.org/10.1037/0000165-000
Aslan, E. (2001). The Turkish version of the Torrance Test of Creative Thinking. Marmara University Atatürk Faculty of Education Journal of Educational Sciences, 14, 19–40. https://izlik.org/JA67XC88NG
Bal İncebacak, B., & Sarışan Tungaç, A., (2024). The effect of project development and execution training on the project culture of Ondokuz Mayıs University undergraduate students. International Congress of Integrated Social Research and Interdisciplinary Studies (pp.114-117). Batumi, Georgia https://avesis.omu.edu.tr/yayin/0fa72b82-3280-415a-be97-36958c41e869/the-effect-of-project-development-and-execution-training-on-the-project-culture-of-ondokuz-mayis-university-undergraduate-students
Bal İncebacak, B., Yaman, S., & Sarışan Tungaç, A., (2023). Online project writing training: Virtual learning competencies and participant opinions. Journal of Interdisciplinary Studies in Education, 12(2), 189-210. https://ojed.org/jise/article/view/4986
Bapoğlu-Dümenci, S.S. (2024). The effect of TÜBİTAK 2237-A scientific education activities on career differences in the undergraduate child development applications department. Journal of University Research, 7(3), 305-311. https://doi.org/10.32329/uad.1493154
Başaran, H., Yıldız, Y., & Satıl, F. (2025). New approaches in geography education and contributions to the literature TÜBİTAK 2237/A evaluation of activity participants' attitudes towards scientific research. Anatolian Academy Journal of Social Sciences, 6(1), 12-20. https://izlik.org/JA54AW63ER

Brookhart, S. M. (2018). How to create and use rubrics for formative assessment and grading. ASCD. (2026, February 15). Retreived from https://www.geocities.ws/bdktraining/pdfkur/How%20to%20Create%20and%20Use%20Rubrics%20for%20Formative%20Assessment%20and%20Grading%20(%20PDFDrive%20).pdf
Büyüköztürk, Ş., & Köklü, N. (1999). Faculty members' views on the research competencies of graduate students studying in the field of educational sciences. Education and Science, 23(112), 18-28. https://doi.org/10.5961/jhes.2018.277
Büyüköztürk, Ş., Kılıç Çakmak, E., Akgün, Ö. E., Karadeniz, Ş., & Demirel, F. (2017). Bilimsel araştırma yöntemleri [Scientific research methods] (25th ed.). Pegem. (2026, February 15). Retreived from https://depo.pegem.net/9789944919289.pdf
Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge. https://doi.org/10.4324/9781315456539
Creswell, J. W. (2014). Research design: qualitative, quantitative, and mixed methods approaches (4th ed.). Sage Publications, Inc. (2026, February 15). Retreived from https://www.ucg.ac.me/skladiste/blog_609332/objava_105202/fajlovi/Creswell.pdf
Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). Sage Publications. (2026, February 15). Retreived from https://www.scirp.org/reference/referencespapers?referenceid=2155979
Daniel, B. (2022). The role of research methodology in enhancing postgraduate students' research experience. Electronic Journal of Business Research Methods, 20(1), 34–48. https://doi.org/10.34190/ejbrm.20.1.2253
DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Sage. (2026, February 15). Retreived from https://www.scirp.org/reference/referencespapers?referenceid=2323603
Ekmekci, O., Hancock, B., Hancock, A., & Swayze, S. (2012). Teaching statistical research methods to graduate students: lessons learned from three different degree programs. International Journal of Teaching and Learning in Higher Education, 24(2), 272–279. (2026, February 15). Retreived from https://hsrc.himmelfarb.gwu.edu/smhs_crl_facpubs/6/
Et, S. Z., & Gömleksiz, M. N. (2022). Graduate students' views on the scientific research process. Gaziantep University Journal of Educational Sciences, 6(Special Issue), 59-82. https://izlik.org/JA42CH25EZ
Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5, 1–4. https://doi.org/10.11648/j.ajtas.20160501.1
Evrekli, E., İnel, D., Deniş, H., & Balım, A.G. (2011). Methodological and statistical problems in graduate theses in the field of science education. Elementary Education Online, 10(1), 206-218. (2026, February 15). Retreived from https://ilkogretim-online.org/index.php/pub/article/view/985
Ezer, F., & Aksüt, S. (2021). Views of graduate students in social studies education on scientific ethics. Electronic Journal of Social Sciences, 20(78), 911–933. https://doi.org/10.17755/esosder.814551
Field, A. P. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). Sage. (2026, February 15). Retreived from https://www.scirp.org/reference/referencespapers?referenceid=3504991
Fraenkel, R. J., & Wallen, E. N. (2000). Research design and evaluation in education (4th ed.). McGraw-Hill. (2026, February 15). Retreived from https://www.scirp.org/reference/referencespapers?referenceid=648980
Goundar, S. (2012). Research methodology and research method. S. Goundar (Ed.), Cloud Computing. Research Gate Publications. (2026, February 15). Retreived from https://www.scirp.org/reference/referencespapers?referenceid=3040379
İnel-Ekici, D., & Balım, A. G. (2013). Problem solving skills perception scale for secondary students: A study of validity and reliability. Yüzüncü Yıl University Journal of Faculty of Education, 10(1), 67-86. https://izlik.org/JA69TA89AG
Jackson, S. L. (2011). Research methods: A modular approach. Belmont. (2026, February 15). Retreived from https://archive.org/details/researchmethodsm0000jack_h4g0
Kaptan, S. (1998). Bilimsel araştırma ve istatistik teknikleri [Scientific research and statistical techniques]. Tekışık.
Karadağ, E. (2009). Thematic analysis of doctoral dissertations in the field of educational sciences. Ahi Evran University Kırşehir Faculty of Education Journal, 10(3), 75-87. https://izlik.org/JA86ZY98HH
Karamustafaoğlu, S., & Meşeci, B. (2021). An examination of education faculty students' attitudes towards the scientific research methods course. Anadolu Teacher Journal, 5(1), 19-38. https://doi.org/10.35346/aod.917301
Karasar, N. (1974). Research education. Ankara University Faculty of Journal of Educational Sciences (JFES), 7(1), 263–274. https://doi.org/10.1501/Egifak_0000000399
Karasar, N. (1984). Research education in Turkish universities. (TÜBİTAK BAYG-E-49 Project). (2026, February 15). Retreived from https://search.trdizin.gov.tr/en/yayin/detay/600381/turk-universitelerinde-arastirma-egitimi.
Karasar, N. (2020). Bilimsel araştırma yöntemi [Scientific research method]. (35th ed.). Nobel.
Kelley, K., Clark, B., Brown, V., & Sitzia J. (2003). Good practice in the conduct and reporting of survey research. International Journal for Quality Health Care, 15(3), 261-266. https://doi.org/10.1093/intqhc/mzg031
Kerlinger, F. N. (2000). Foundations of behavioral research. Harcourt College Publishers. (2026, February 15). Retreived from https://archive.org/details/foundationsofbeh0000kerl_x7k9
Kim, K. H. (2011). The creativity crisis: The decrease in creative thinking scores on the Torrance Tests of Creative Thinking. Creativity Research Journal, 23(4), 285–295, https://doi.org/10.1080/10400419.2011.627805
Landis, J.R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174. https://doi.org/10.2307/2529310
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Sage Publications. http://dx.doi.org/10.1016/0147-1767(85)90062-8
Marshall, C., & Rossman, G. (2016). Designing qualitative research. (6th Ed), Sage. (2026, February 15). Retreived from https://www.scirp.org/reference/ReferencesPapers?ReferenceID=2043112
Mason, M. (2010). Sample size and saturation in PhD studies using qualitative interviews. Forum: Qualitative Social Research, 11(3). https://doi.org/10.17169/fqs-11.3.1428
Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). Sage Publications. (2026, February 15). Retreived from https://www.scirp.org/reference/referencespapers?referenceid=1977773
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16. https://doi.org/10.1177/1609406917733847
Özdamar, K. (2003). Modern bilimsel araştırma yöntemleri [Modern scientific research methods]. Kaan.
Özkan, M. (2019). Why does an educational scientist need research? Ed. S. Turan. Research methods in education (pp. 1-9). Nobel.
Özkan, Y. Ö., & Şenyurt, S. (2017). Thematic and methodological analysis of master's theses in the field of measurement and evaluation in education. Elementary Education Online, 16(2), 628-653. (2026, February 15). Retreived from https://ilkogretim-online.org/index.php/pub/article/view/275
Patton, M. Q. (2015). Qualitative evaluation and research methods. Thousand Oaks, Sage.
Picardi, C. A., & Masick, K. D. (2013). Research methods: designing and conducting research with a real-world focus. Sage Publications, Inc.
Polly, D., Burchard, K. P., Castillo, C., Drake, P., Horne, S., Howerton, A., ... & Schmitt, K. (2020). Examining action research and teacher inquiry projects: How do they help future and current teachers? School-University Partnerships, 12(4), 36-47.
Sağdıç, A., Çelik, H., & Karamustafaoğlu, O. (2017). The effect of academic advising and qualitative research training program on young researchers' project proposal preparation skills. Journal of Field Education Research, 3(1), 1-11. https://izlik.org/JA28FZ66UF
Şahin, M. (2023). Metaphorical perceptions and opinions of teacher candidates regarding the research methods in education course. ISPEC International Journal of Social Sciences & Humanities, 7(1), 74–94. https://doi.org/10.5281/zenodo.7766236
Sevim, E. (2024). Students' views on problems encountered in the graduate education process. Recep Tayyip Erdoğan University Journal of Education (REFAD), 4(2), 20-45. https://izlik.org/JA75ZW82RE
Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1–22. https://doi.org/10.17763/haer.57.1.j463w79r56455411
Şimşek, H. (2012). Qualitative research methods in social sciences: A guide for researchers. Education and Science, 37(163), 139–156.
Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson. (2026, February 15). Retreived from https://scirp.org/reference/referencespapers?referenceid=3132273
Taşdemir, M., & Taşdemir, A. (2011). Prospective teachers' competence in reviewing scientific research. Selçuk University Journal of Social Sciences Institute, 26, 343-353. https://izlik.org/JA69FL63TC
TÜBİTAK. (2023). 2237-A scientific education activities support program call announcement. The Scientific and Technological Research Council of Türkiye. (2026, February 15). Retreived from https://tubitak.gov.tr/sites/default/files/27489/2237a_cagri_duyurusu_28_02_2023.pdf
Unrau, Y.A., & Beck, A.R. (2004). Increasing research self-efficacy among students in professional academic programs. Innovative Higher Education, 28, 187–204. https://doi.org/10.1023/B:IHIE.0000015107.51904.95
Yaman, S., Bal İncebacak, B., & Sarışan Tungaç, A. (2021). Impacts of project preparation course for students studying at postgraduate education in field of educational sciences: A national project example. International Journal of Psychology and Educational Studies, 8(2), 88–99. https://doi.org/10.52380/ijpes.2021.8.2.367
Yaşar, Ş., & Papatğa, E. (2015). An examination of graduate theses on primary school mathematics courses. Trakya University Journal of Education Faculty, 5(2), 113-124. https://dergipark.org.tr/tr/pub/trkefd/issue/21482/230218
Yıldırım, A., & Şimşek, H. (2021). Sosyal bilimlerde nitel araştırma yöntemleri [Qualitative research methods in social sciences] (12th ed.). Seçkin.

Details

Primary Language

English

Subjects

Instructional Technologies

Journal Section

Research Article

Authors

Soner Mehmet Özdemir ^*
0000-0002-7236-946X
Türkiye

Belgin Bal İncebacak
0000-0003-4643-8051
Türkiye

Şadiye Karaşah Çakıcı
0000-0002-6673-6366
Türkiye

Hilal Demirel
0000-0003-2731-8521
Türkiye

Publication Date

May 4, 2026

Submission Date

December 28, 2025

Acceptance Date

February 16, 2026

Published in Issue

Year 2026 Volume: 13 Number: 3

DOI

https://doi.org/10.17275/per.26.39.13.3

IZ

https://izlik.org/JA33TN39GT

APA

Özdemir, S. M., Bal İncebacak, B., Karaşah Çakıcı, Ş., & Demirel, H. (2026). Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation. Participatory Educational Research, 13(3), 162-182. https://doi.org/10.17275/per.26.39.13.3

AMA

1.Özdemir SM, Bal İncebacak B, Karaşah Çakıcı Ş, Demirel H. Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation. PER. 2026;13(3):162-182. doi:10.17275/per.26.39.13.3

Chicago

Özdemir, Soner Mehmet, Belgin Bal İncebacak, Şadiye Karaşah Çakıcı, and Hilal Demirel. 2026. “Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation”. Participatory Educational Research 13 (3): 162-82. https://doi.org/10.17275/per.26.39.13.3.

EndNote

Özdemir SM, Bal İncebacak B, Karaşah Çakıcı Ş, Demirel H (May 1, 2026) Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation. Participatory Educational Research 13 3 162–182.

IEEE

[1]S. M. Özdemir, B. Bal İncebacak, Ş. Karaşah Çakıcı, and H. Demirel, “Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation”, PER, vol. 13, no. 3, pp. 162–182, May 2026, doi: 10.17275/per.26.39.13.3.

ISNAD

Özdemir, Soner Mehmet - Bal İncebacak, Belgin - Karaşah Çakıcı, Şadiye - Demirel, Hilal. “Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation”. Participatory Educational Research 13/3 (May 1, 2026): 162-182. https://doi.org/10.17275/per.26.39.13.3.

JAMA

1.Özdemir SM, Bal İncebacak B, Karaşah Çakıcı Ş, Demirel H. Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation. PER. 2026;13:162–182.

MLA

Özdemir, Soner Mehmet, et al. “Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation”. Participatory Educational Research, vol. 13, no. 3, May 2026, pp. 162-8, doi:10.17275/per.26.39.13.3.

Vancouver

1.Soner Mehmet Özdemir, Belgin Bal İncebacak, Şadiye Karaşah Çakıcı, Hilal Demirel. Reflections of the Applied Research Methods Course on Graduate (Master’s) Students’ Performance: A Methodological Evaluation. PER. 2026 May 1;13(3):162-8. doi:10.17275/per.26.39.13.3