Development and Validation of Research Skills Instruments for Pre-service Biology Teachers

Year 2025, Volume: 12 Issue: 2, 75 - 96

Febblina Daryanes , Siti Zubaidah , Susriyati Mahanal , Sulisetijono Sulisetijono

https://doi.org/10.17275/per.25.20.12.2

Abstract

Research skills are essential for navigating the demands of the 21st century, as they allow students to become accustomed to doing critical analysis in a productive context to uncover knowledge and solutions and boost their future career prospects. However, there are still relatively few studies that develop research skills instruments. This study aims to fill the gap by developing and validating the research skills instruments. We developed and validated a research skills instrument using expert ratings of biology education and surveys. The survey was conducted on 408 respondents, namely pre-service biology teachers. Data were analyzed through descriptive analysis, Exploratory Factor Analysis (EFA), followed by Confirmatory Factor Analysis (CFA) calculated to validate and confirm the final dimensions of the newly developed instrument. This series of analysis produces 22 statement items with four dimensions, namely Embark & Clarify (EmC), composed of seven items; Find & Manage (FM), consisting of six items; Identify & Generate (IG), composed of four items; Evaluate & Communicate (EvC) consisting of five items. The CFA results match the proposed model to observational data. The study indicate that the dimension that best describes students’ research skills is Evaluate & Communicate. The research skills instrument developed has an adequate internal consistency value, indicating that it can be used to assess student research skills. This study recommends a research skills instrument to evaluate students' research skills to produce graduates with scientific skills.

Keywords

dimensions of research skills, preservice biology teacher students, psychometric analysis

Ethical Statement

The authors stated that the highest ethical guidelines were followed throughout this study.

Supporting Institution

This research obtained funds from The Bureau of Higher Education Finance (BPPT) Ministry of Education, Culture, Research, and Technology and the Indonesia Endowment Fund for Education (LPDP).

Thanks

Thank you to Mr. Muhammad Saefi, who provided valuable suggestions while writing this manuscript.

References

• Abbott, D. (2019). Game-based learning for postgraduates: An empirical study of an educational game to teach research skills. Higher Education Pedagogies, 4(1), 80–104. https://doi.org/10.1080/23752696.2019.1629825
• Ain, C. T., Sabir, F., & Willison, J. (2019). Research skills that men and women developed at university and then used in workplaces. Studies in Higher Education, 44(12), 2346–2358. https://doi.org/10.1080/03075079.2018.1496412
• Asghar, A. U. R., Aksoy, M., Graham, A. I., & Baseler, H. A. (2023). Developing research skills in medical students online using an active research study. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04781-5
• Awodoyin, A. F., Adetoro, N., & Oke, P. (2021). Perceived research skills of graduating library and information science (LIS) undergraduates in a Nigerian University of Education. Library Philosophy & Practice, 1–23. http://pbidi.unam.mx:8080/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=edo&AN=153746229&lang=es&site=eds-live
• Bandaranaike, S. (2018). From research skill development to work skill development. Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.7
• Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment and Evaluation in Higher Education, 38(6), 698–712. https://doi.org/10.1080/02602938.2012.691462
• Brezavšček, A., Šparl, P., & Žnidaršič, A. (2017). Factors influencing the behavioural intention to use statistical software: The perspective of the Slovenian students of social sciences. Eurasia Journal of Mathematics, Science and Technology Education, 13(3), 953–986. https://doi.org/10.12973/eurasia.2017.00652a
• Bueno, D. (2017). Research Skills of the Professorial Lecturers: Input to Capability Building. JPAIR Institutional Research, 9(9), 1–17. https://doi.org/10.7719/irj.v9i9.489
• Carberry, C., McCombe, G., Tobin, H., Stokes, D., Last, J., Bury, G., & Cullen, W. (2021). Curriculum initiatives to enhance research skills acquisition by medical students: a scoping review. BMC Medical Education, 21(1), 1–13. https://doi.org/10.1186/s12909-021-02754-0
• Carrió, M., Baños, J.-E., & Rodríguez, G. (2022). Comparison of the Effect of Two Hybrid Models of Problem-Based Learning Implementation on the Development of Transversal and Research Skills and the Learning Experience. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.875860
• Castillo-Martínez, I. M., & Ramírez-Montoya, M. S. (2021). Research Competencies to Develop Academic Reading and Writing: A Systematic Literature Review. Frontiers in Education, 5(January), 1–12. https://doi.org/10.3389/feduc.2020.576961
• Corchon, S., Watson, R., Arantzamendi, M., & Saracíbar, M. (2010). Design and validation of an instrument to measure nursing research culture: The Nursing Research Questionnaire (NRQ). Journal of Clinical Nursing, 19(1–2), 217–226. https://doi.org/10.1111/j.1365-2702.2009.03049.x
• Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Pearson Education: In Educational Research.
• Damopolii, I., Botutihe, V. T., & Nunaki, J. H. (2019). The contribution of science process skill towards students cognitive achievement through guided inquiry-based learning. Journal of Physics: Conference Series, 1317(1). https://doi.org/10.1088/1742-6596/1317/1/012184
• Delgado, C. L. P., & Estrada, L. (2022). Pedagogical Conditions and Challenges for the Development of Research Skills. Revista Electronica de Investigacion Educativa, 24. https://doi.org/10.24320/redie.2022.24.e09.3937
• Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in Second Language Research. New York: Routledge.
• Galvez, G., Killilea, D. W., Berry, S., Narayanaswami, V., & Fung, E. B. (2024). Increasing STEM Skills, Knowledge and Interest Among Diverse Students: Results from an Intensive Summer Research Program at the University of California, San Francisco. Innovative Higher Education, February. https://doi.org/10.1007/s10755-024-09701-z
• George-Reyes, C. E., López-Caudana, E. O., & Ramírez-Montoya, M. S. (2023). Research competencies in university students: Intertwining complex thinking and Education 4.0. Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13767
• Gyuris, E. (2018). Evaluating the effectiveness of postgraduate research skills training and its alignment with the research skill development framework. Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.5
• Heikkilä, M., Hermansen, H., Iiskala, T., Mikkilä-Erdmann, M., & Warinowski, A. (2023). Epistemic agency in student teachers’ engagement with research skills. Teaching in Higher Education, 28(3), 455–472. https://doi.org/10.1080/13562517.2020.1821638
• Hendriarto, P., Mursidi, A., Kalbuana, N., Aini, N., & Aslan, A. (2021). Understanding the Implications of Research Skills Development Framework for Indonesian Academic Outcomes Improvement. Jurnal Iqra’ : Kajian Ilmu Pendidikan, 6(2), 51–60. https://doi.org/10.25217/ji.v6i2.1405
• Hoffmeister, T., Koch, H., & Tremp, P. (2020). Forschendes Lernen als Studiengangsprofil. Germany: Springer Vs.
• Hordern, J. (2019). Knowledge, evidence, and the configuration of educational practice. Education Sciences, 9(2). https://doi.org/10.3390/educsci9020070
• Hughes, G. (2019). Developing student research capability for a ‘post-truth’ world: three challenges for integrating research across taught programmes. Teaching in Higher Education, 24(3), 394–411. https://doi.org/10.1080/13562517.2018.1541173
• Kelly, S. L. (2019). Faculty perceptions of librarian value: The moderating relationship between librarian contact, course goals, and students’ research skills. Journal of Academic Librarianship, 45(3), 228–233. https://doi.org/10.1016/j.acalib.2019.03.003
• Khalaf, M. A., & Alshammari, A. (2023). Effects of Project-Based Learning on Postgraduate Students’ Research Proposal Writing Skills. European Journal of Educational Research, 12(1), 189–200. https://doi.org/10.12973/eu-jer.12.1.189
• Lee, M. G. Y., Hu, W. C. Y., & Bilszta, J. L. C. (2020). Determining Expected Research Skills of Medical Students on Graduation: a Systematic Review. Medical Science Educator, 30(4), 1465–1479. https://doi.org/10.1007/s40670-020-01059-z
• Leupen, S. M., Kephart, K. L., & Hodges, L. C. (2020). Factors influencing quality of team discussion: Discourse analysis in an undergraduate team-based learning biology course. CBE Life Sciences Education, 19(1). https://doi.org/10.1187/cbe.19-06-0112
• Maddens, L., Depaepe, F., Janssen, R., Raes, A., & Elen, J. (2020). Evaluating the Leuven Research Skills Test for 11th and 12th Grade. Journal of Psychoeducational Assessment, 38(4), 445–459. https://doi.org/10.1177/0734282918825040
• Mahanal, S., Zubaidah, S., Setiawan, D., Maghfiroh, H., & Muhaimin, F. G. (2022). Empowering College Students’ Problem-Solving Skills through RICOSRE. Education Sciences, 12(3). https://doi.org/10.3390/educsci12030196
• Mahanal, S., Zubaidah, S., Sumiati, I. D., Sari, T. M., & Ismirawati, N. (2019). RICOSRE: A learning model to develop critical thinking skills for students with different academic abilities. International Journal of Instruction, 12(2), 417–434. https://doi.org/10.29333/iji.2019.12227a
• Mahasneh, O. M. (2020). The effectiveness of flipped learning strategy in the development of scientific research skills in procedural research course among higher education diploma students. Research in Learning Technology, 28(1063519), 1–17. https://doi.org/10.25304/rlt.v28.2327
• Mallidou, A. A., Borycki, E., Frisch, N., & Young, L. (2018). Research competencies assessment instrument for nurses: Preliminary psychometric properties. Journal of Nursing Measurement, 26(3), E159–E177. https://doi.org/10.1891/1061-3749.26.3.E159
• Marlina, R., Suwono, H., Yuenyong, C., Ibrohim, I., Mahanal, S., Saefi, M., & Hamdani, H. (2023). Technological Pedagogical Content Knowledge (TPACK) for Pre-service Biology Teachers: Two Insights More Promising. Participatory Educational Research, 10(6), 245–265. https://doi.org/10.17275/per.23.99.10.6
• Mataniari, R., Willison, J., Hasibuan, M. H. E., Sulistiyo, U., & Dewi, F. (2020). Portraying students’ critical thinking skills through research skill development (RSD) framework: A case of a biology course in an Indonesian University. Journal of Turkish Science Education, 17(2), 302–314. https://doi.org/10.36681/tused.2020.28
• Meerah, T. S. M., Osman, K., Zakaria, E., Ikhsan, Z. H., Krish, P., Lian, D. K. C., & Mahmod, D. (2012). Developing an Instrument to Measure Research Skills. Procedia - Social and Behavioral Sciences, 60, 630–636. https://doi.org/10.1016/j.sbspro.2012.09.434
• Meissner, D., & Shmatko, N. (2019). Integrating professional and academic knowledge: the link between researchers skills and innovation culture. Journal of Technology Transfer, 44(4), 1273–1289. https://doi.org/10.1007/s10961-018-9662-8
• Meyers, L., Gamst, G., & Guarino, A. . (2017). Applied Multivariate Research. SAGE.
• Mora-López, N., & Bernárdez-Vilaboa, R. (2023). Exploratory Study on the Blended Learning of Research and Language Skills in EFL and Interinstitutional Assessment. Education Sciences, 13(2). https://doi.org/10.3390/educsci13020155
• Noguez, J., & Neri, L. (2019). Research-based learning: a case study for engineering students. International Journal on Interactive Design and Manufacturing, 13(4), 1283–1295. https://doi.org/10.1007/s12008-019-00570-x
• Opitz, A., Heene, M., & Fischer, F. (2017). Measuring scientific reasoning–a review of test instruments. Educational Research and Evaluation, 23(3–4), 78–101. https://doi.org/10.1080/13803611.2017.1338586
• Peiró-Signes, Á., Trull, O., Segarra-Oña, M., & García-Díaz, J. C. (2021). Anxiety towards statistics and its relationship with students’ attitudes and learning approach. Behavioral Sciences, 11(3). https://doi.org/10.3390/bs11030032
• Perez, A., Rabionet, S., & Bleidt, B. (2017). Teaching research skills to student pharmacists in one semester: An applied research elective. American Journal of Pharmaceutical Education, 81(1). https://doi.org/10.5688/ajpe81116
• Qiu, C., Feng, X., Reinhardt, J. D., & Li, J. (2019). Development and psychometric testing of the Research Competency Scale for Nursing Students: An instrument design study. Nurse Education Today, 79(37), 198–203. https://doi.org/10.1016/j.nedt.2019.05.039
• Rodrigues, I. B., Adachi, J. D., Beattie, K. A., & MacDermid, J. C. (2017). Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskeletal Disorders, 18(1), 1–9. https://doi.org/10.1186/s12891-017-1914-5
• Rodríguez, G., Pérez, N., Núñez, G., Baños, J. E., & Carrió, M. (2019). Developing creative and research skills through an open and interprofessional inquiry-based learning course. BMC Medical Education, 19(1), 1–13. https://doi.org/10.1186/s12909-019-1563-5
• Saefi, M., Fauzi, A., Kristiana, E., Adi, W. C., Muchson, M., Setiawan, M. E., Islami, N. N., Fitria Ningrum, D. E. A., Ikhsan, M. A., & Ramadhani, M. (2020). Validating of Knowledge, Attitudes, and Practices Questionnaire for Prevention of COVID-19 infections among Undergraduate Students: A RASCH and Factor Analysis. Eurasia Journal of Mathematics, Science and Technology Education, 16(12), 1–14. https://doi.org/10.29333/ejmste/9352
• Suwono, H., Maulidia, L., Saefi, M., Kusairi, S., & Yuenyong, C. (2022). The Development and Validation of an Instrument of Prospective Science Teachers’ Perceptions of Scientific Literacy. Eurasia Journal of Mathematics, Science and Technology Education, 18(1). https://doi.org/10.29333/EJMSTE/11505
• Swank, J. M., & Lambie, G. W. (2016). Development of the Research Competencies Scale. Measurement and Evaluation in Counseling and Development, 49(2), 91–108. https://doi.org/10.1177/0748175615625749
• Tabachnick, B, G., & Fidell, L. S. (2007). Using Multivariate Statistics. California: Pearson.
• Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics. In Contemporary Psychology: A Journal of Reviews (Vol. 28, Issue 8). United States of America: Pearson Education. https://doi.org/10.1037/022267
• Tajuria, G., Dobel-Ober, D., Bradley, E., Charnley, C., Lambley-Burke, R., Mallen, C., Honeyford, K., & Kingstone, T. (2024). Evaluating the impact of the supporting the advancement of research skills (STARS) programme on research knowledge, engagement and capacity-building in a health and social care organisation in England. BMC Medical Education, 24(1). https://doi.org/10.1186/s12909-024-05059-0
• Torres, L. (2018). Research skills in the first-year biology practical - Are they there? Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.3
• Willison, J., & Pijlman, F. B. (2016). PhD prepared: research skill development across the undergraduate years. International Journal for Researcher Development, 7(1), 63–83. https://doi.org/10.1108/ijrd-07-2015-0018
• Zapata, M. I., Quiñones, J. F., Palacios, J. B., Inca, W. A., Negrete, M. Q., & Zegarra, D. V. (2023). Research skills for university students’ thesis in E-learning: Scale development and validation in Peru. Heliyon, 9(3). https://doi.org/10.1016/j.heliyon.2023.e13770
• Zubaidah, S., Corebima, A. D., Mahanal, S., & Mistianah. (2018). Revealing the relationship between reading interest and critical thinking skills through remap GI and remap jigsaw. International Journal of Instruction, 11(2), 41–56. https://doi.org/10.12973/iji.2018.1124a
• Zubaidah, S., Mahanal, S., Rosyida, F., Kurniawati, Z. L., Sholihah, M., & Ismirawati, N. (2018). Using remap-TmPS learning to improve low-ability students’ critical thinking skills. Asia-Pacific Forum on Science Learning and Teaching, 19(1).