Development and Validation of Research Skills Instruments for Pre-service Biology Teachers

Febblina Daryanes; Siti Zubaidah; Susriyati Mahanal; Sulisetijono Sulisetijono

doi:10.17275/per.25.20.12.2

EN

Development and Validation of Research Skills Instruments for Pre-service Biology Teachers

Abstract

Research skills are essential for navigating the demands of the 21st century, as they allow students to become accustomed to doing critical analysis in a productive context to uncover knowledge and solutions and boost their future career prospects. However, there are still relatively few studies that develop research skills instruments. This study aims to fill the gap by developing and validating the research skills instruments. We developed and validated a research skills instrument using expert ratings of biology education and surveys. The survey was conducted on 408 respondents, namely pre-service biology teachers. Data were analyzed through descriptive analysis, Exploratory Factor Analysis (EFA), followed by Confirmatory Factor Analysis (CFA) calculated to validate and confirm the final dimensions of the newly developed instrument. This series of analysis produces 22 statement items with four dimensions, namely Embark & Clarify (EmC), composed of seven items; Find & Manage (FM), consisting of six items; Identify & Generate (IG), composed of four items; Evaluate & Communicate (EvC) consisting of five items. The CFA results match the proposed model to observational data. The study indicate that the dimension that best describes students’ research skills is Evaluate & Communicate. The research skills instrument developed has an adequate internal consistency value, indicating that it can be used to assess student research skills. This study recommends a research skills instrument to evaluate students' research skills to produce graduates with scientific skills.

Keywords

dimensions of research skills, preservice biology teacher students, psychometric analysis

Supporting Institution

This research obtained funds from The Bureau of Higher Education Finance (BPPT) Ministry of Education, Culture, Research, and Technology and the Indonesia Endowment Fund for Education (LPDP).

Ethical Statement

The authors stated that the highest ethical guidelines were followed throughout this study.

Thanks

Thank you to Mr. Muhammad Saefi, who provided valuable suggestions while writing this manuscript.

References

Abbott, D. (2019). Game-based learning for postgraduates: An empirical study of an educational game to teach research skills. Higher Education Pedagogies, 4(1), 80–104. https://doi.org/10.1080/23752696.2019.1629825
Ain, C. T., Sabir, F., & Willison, J. (2019). Research skills that men and women developed at university and then used in workplaces. Studies in Higher Education, 44(12), 2346–2358. https://doi.org/10.1080/03075079.2018.1496412
Asghar, A. U. R., Aksoy, M., Graham, A. I., & Baseler, H. A. (2023). Developing research skills in medical students online using an active research study. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04781-5
Awodoyin, A. F., Adetoro, N., & Oke, P. (2021). Perceived research skills of graduating library and information science (LIS) undergraduates in a Nigerian University of Education. Library Philosophy & Practice, 1–23. http://pbidi.unam.mx:8080/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=edo&AN=153746229&lang=es&site=eds-live
Bandaranaike, S. (2018). From research skill development to work skill development. Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.7
Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment and Evaluation in Higher Education, 38(6), 698–712. https://doi.org/10.1080/02602938.2012.691462
Brezavšček, A., Šparl, P., & Žnidaršič, A. (2017). Factors influencing the behavioural intention to use statistical software: The perspective of the Slovenian students of social sciences. Eurasia Journal of Mathematics, Science and Technology Education, 13(3), 953–986. https://doi.org/10.12973/eurasia.2017.00652a
Bueno, D. (2017). Research Skills of the Professorial Lecturers: Input to Capability Building. JPAIR Institutional Research, 9(9), 1–17. https://doi.org/10.7719/irj.v9i9.489
Carberry, C., McCombe, G., Tobin, H., Stokes, D., Last, J., Bury, G., & Cullen, W. (2021). Curriculum initiatives to enhance research skills acquisition by medical students: a scoping review. BMC Medical Education, 21(1), 1–13. https://doi.org/10.1186/s12909-021-02754-0
Carrió, M., Baños, J.-E., & Rodríguez, G. (2022). Comparison of the Effect of Two Hybrid Models of Problem-Based Learning Implementation on the Development of Transversal and Research Skills and the Learning Experience. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.875860

Castillo-Martínez, I. M., & Ramírez-Montoya, M. S. (2021). Research Competencies to Develop Academic Reading and Writing: A Systematic Literature Review. Frontiers in Education, 5(January), 1–12. https://doi.org/10.3389/feduc.2020.576961
Corchon, S., Watson, R., Arantzamendi, M., & Saracíbar, M. (2010). Design and validation of an instrument to measure nursing research culture: The Nursing Research Questionnaire (NRQ). Journal of Clinical Nursing, 19(1–2), 217–226. https://doi.org/10.1111/j.1365-2702.2009.03049.x
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Pearson Education: In Educational Research.
Damopolii, I., Botutihe, V. T., & Nunaki, J. H. (2019). The contribution of science process skill towards students cognitive achievement through guided inquiry-based learning. Journal of Physics: Conference Series, 1317(1). https://doi.org/10.1088/1742-6596/1317/1/012184
Delgado, C. L. P., & Estrada, L. (2022). Pedagogical Conditions and Challenges for the Development of Research Skills. Revista Electronica de Investigacion Educativa, 24. https://doi.org/10.24320/redie.2022.24.e09.3937
Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in Second Language Research. New York: Routledge.
Galvez, G., Killilea, D. W., Berry, S., Narayanaswami, V., & Fung, E. B. (2024). Increasing STEM Skills, Knowledge and Interest Among Diverse Students: Results from an Intensive Summer Research Program at the University of California, San Francisco. Innovative Higher Education, February. https://doi.org/10.1007/s10755-024-09701-z
George-Reyes, C. E., López-Caudana, E. O., & Ramírez-Montoya, M. S. (2023). Research competencies in university students: Intertwining complex thinking and Education 4.0. Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13767
Gyuris, E. (2018). Evaluating the effectiveness of postgraduate research skills training and its alignment with the research skill development framework. Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.5
Heikkilä, M., Hermansen, H., Iiskala, T., Mikkilä-Erdmann, M., & Warinowski, A. (2023). Epistemic agency in student teachers’ engagement with research skills. Teaching in Higher Education, 28(3), 455–472. https://doi.org/10.1080/13562517.2020.1821638
Hendriarto, P., Mursidi, A., Kalbuana, N., Aini, N., & Aslan, A. (2021). Understanding the Implications of Research Skills Development Framework for Indonesian Academic Outcomes Improvement. Jurnal Iqra’ : Kajian Ilmu Pendidikan, 6(2), 51–60. https://doi.org/10.25217/ji.v6i2.1405
Hoffmeister, T., Koch, H., & Tremp, P. (2020). Forschendes Lernen als Studiengangsprofil. Germany: Springer Vs.
Hordern, J. (2019). Knowledge, evidence, and the configuration of educational practice. Education Sciences, 9(2). https://doi.org/10.3390/educsci9020070
Hughes, G. (2019). Developing student research capability for a ‘post-truth’ world: three challenges for integrating research across taught programmes. Teaching in Higher Education, 24(3), 394–411. https://doi.org/10.1080/13562517.2018.1541173
Kelly, S. L. (2019). Faculty perceptions of librarian value: The moderating relationship between librarian contact, course goals, and students’ research skills. Journal of Academic Librarianship, 45(3), 228–233. https://doi.org/10.1016/j.acalib.2019.03.003
Khalaf, M. A., & Alshammari, A. (2023). Effects of Project-Based Learning on Postgraduate Students’ Research Proposal Writing Skills. European Journal of Educational Research, 12(1), 189–200. https://doi.org/10.12973/eu-jer.12.1.189
Lee, M. G. Y., Hu, W. C. Y., & Bilszta, J. L. C. (2020). Determining Expected Research Skills of Medical Students on Graduation: a Systematic Review. Medical Science Educator, 30(4), 1465–1479. https://doi.org/10.1007/s40670-020-01059-z
Leupen, S. M., Kephart, K. L., & Hodges, L. C. (2020). Factors influencing quality of team discussion: Discourse analysis in an undergraduate team-based learning biology course. CBE Life Sciences Education, 19(1). https://doi.org/10.1187/cbe.19-06-0112
Maddens, L., Depaepe, F., Janssen, R., Raes, A., & Elen, J. (2020). Evaluating the Leuven Research Skills Test for 11th and 12th Grade. Journal of Psychoeducational Assessment, 38(4), 445–459. https://doi.org/10.1177/0734282918825040
Mahanal, S., Zubaidah, S., Setiawan, D., Maghfiroh, H., & Muhaimin, F. G. (2022). Empowering College Students’ Problem-Solving Skills through RICOSRE. Education Sciences, 12(3). https://doi.org/10.3390/educsci12030196
Mahanal, S., Zubaidah, S., Sumiati, I. D., Sari, T. M., & Ismirawati, N. (2019). RICOSRE: A learning model to develop critical thinking skills for students with different academic abilities. International Journal of Instruction, 12(2), 417–434. https://doi.org/10.29333/iji.2019.12227a
Mahasneh, O. M. (2020). The effectiveness of flipped learning strategy in the development of scientific research skills in procedural research course among higher education diploma students. Research in Learning Technology, 28(1063519), 1–17. https://doi.org/10.25304/rlt.v28.2327
Mallidou, A. A., Borycki, E., Frisch, N., & Young, L. (2018). Research competencies assessment instrument for nurses: Preliminary psychometric properties. Journal of Nursing Measurement, 26(3), E159–E177. https://doi.org/10.1891/1061-3749.26.3.E159
Marlina, R., Suwono, H., Yuenyong, C., Ibrohim, I., Mahanal, S., Saefi, M., & Hamdani, H. (2023). Technological Pedagogical Content Knowledge (TPACK) for Pre-service Biology Teachers: Two Insights More Promising. Participatory Educational Research, 10(6), 245–265. https://doi.org/10.17275/per.23.99.10.6
Mataniari, R., Willison, J., Hasibuan, M. H. E., Sulistiyo, U., & Dewi, F. (2020). Portraying students’ critical thinking skills through research skill development (RSD) framework: A case of a biology course in an Indonesian University. Journal of Turkish Science Education, 17(2), 302–314. https://doi.org/10.36681/tused.2020.28
Meerah, T. S. M., Osman, K., Zakaria, E., Ikhsan, Z. H., Krish, P., Lian, D. K. C., & Mahmod, D. (2012). Developing an Instrument to Measure Research Skills. Procedia - Social and Behavioral Sciences, 60, 630–636. https://doi.org/10.1016/j.sbspro.2012.09.434
Meissner, D., & Shmatko, N. (2019). Integrating professional and academic knowledge: the link between researchers skills and innovation culture. Journal of Technology Transfer, 44(4), 1273–1289. https://doi.org/10.1007/s10961-018-9662-8
Meyers, L., Gamst, G., & Guarino, A. . (2017). Applied Multivariate Research. SAGE.
Mora-López, N., & Bernárdez-Vilaboa, R. (2023). Exploratory Study on the Blended Learning of Research and Language Skills in EFL and Interinstitutional Assessment. Education Sciences, 13(2). https://doi.org/10.3390/educsci13020155
Noguez, J., & Neri, L. (2019). Research-based learning: a case study for engineering students. International Journal on Interactive Design and Manufacturing, 13(4), 1283–1295. https://doi.org/10.1007/s12008-019-00570-x
Opitz, A., Heene, M., & Fischer, F. (2017). Measuring scientific reasoning–a review of test instruments. Educational Research and Evaluation, 23(3–4), 78–101. https://doi.org/10.1080/13803611.2017.1338586
Peiró-Signes, Á., Trull, O., Segarra-Oña, M., & García-Díaz, J. C. (2021). Anxiety towards statistics and its relationship with students’ attitudes and learning approach. Behavioral Sciences, 11(3). https://doi.org/10.3390/bs11030032
Perez, A., Rabionet, S., & Bleidt, B. (2017). Teaching research skills to student pharmacists in one semester: An applied research elective. American Journal of Pharmaceutical Education, 81(1). https://doi.org/10.5688/ajpe81116
Qiu, C., Feng, X., Reinhardt, J. D., & Li, J. (2019). Development and psychometric testing of the Research Competency Scale for Nursing Students: An instrument design study. Nurse Education Today, 79(37), 198–203. https://doi.org/10.1016/j.nedt.2019.05.039
Rodrigues, I. B., Adachi, J. D., Beattie, K. A., & MacDermid, J. C. (2017). Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskeletal Disorders, 18(1), 1–9. https://doi.org/10.1186/s12891-017-1914-5
Rodríguez, G., Pérez, N., Núñez, G., Baños, J. E., & Carrió, M. (2019). Developing creative and research skills through an open and interprofessional inquiry-based learning course. BMC Medical Education, 19(1), 1–13. https://doi.org/10.1186/s12909-019-1563-5
Saefi, M., Fauzi, A., Kristiana, E., Adi, W. C., Muchson, M., Setiawan, M. E., Islami, N. N., Fitria Ningrum, D. E. A., Ikhsan, M. A., & Ramadhani, M. (2020). Validating of Knowledge, Attitudes, and Practices Questionnaire for Prevention of COVID-19 infections among Undergraduate Students: A RASCH and Factor Analysis. Eurasia Journal of Mathematics, Science and Technology Education, 16(12), 1–14. https://doi.org/10.29333/ejmste/9352
Suwono, H., Maulidia, L., Saefi, M., Kusairi, S., & Yuenyong, C. (2022). The Development and Validation of an Instrument of Prospective Science Teachers’ Perceptions of Scientific Literacy. Eurasia Journal of Mathematics, Science and Technology Education, 18(1). https://doi.org/10.29333/EJMSTE/11505
Swank, J. M., & Lambie, G. W. (2016). Development of the Research Competencies Scale. Measurement and Evaluation in Counseling and Development, 49(2), 91–108. https://doi.org/10.1177/0748175615625749
Tabachnick, B, G., & Fidell, L. S. (2007). Using Multivariate Statistics. California: Pearson.
Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics. In Contemporary Psychology: A Journal of Reviews (Vol. 28, Issue 8). United States of America: Pearson Education. https://doi.org/10.1037/022267
Tajuria, G., Dobel-Ober, D., Bradley, E., Charnley, C., Lambley-Burke, R., Mallen, C., Honeyford, K., & Kingstone, T. (2024). Evaluating the impact of the supporting the advancement of research skills (STARS) programme on research knowledge, engagement and capacity-building in a health and social care organisation in England. BMC Medical Education, 24(1). https://doi.org/10.1186/s12909-024-05059-0
Torres, L. (2018). Research skills in the first-year biology practical - Are they there? Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.3
Willison, J., & Pijlman, F. B. (2016). PhD prepared: research skill development across the undergraduate years. International Journal for Researcher Development, 7(1), 63–83. https://doi.org/10.1108/ijrd-07-2015-0018
Zapata, M. I., Quiñones, J. F., Palacios, J. B., Inca, W. A., Negrete, M. Q., & Zegarra, D. V. (2023). Research skills for university students’ thesis in E-learning: Scale development and validation in Peru. Heliyon, 9(3). https://doi.org/10.1016/j.heliyon.2023.e13770
Zubaidah, S., Corebima, A. D., Mahanal, S., & Mistianah. (2018). Revealing the relationship between reading interest and critical thinking skills through remap GI and remap jigsaw. International Journal of Instruction, 11(2), 41–56. https://doi.org/10.12973/iji.2018.1124a
Zubaidah, S., Mahanal, S., Rosyida, F., Kurniawati, Z. L., Sholihah, M., & Ismirawati, N. (2018). Using remap-TmPS learning to improve low-ability students’ critical thinking skills. Asia-Pacific Forum on Science Learning and Teaching, 19(1).

Details

Primary Language

English

Subjects

Higher Education Studies (Other)

Journal Section

Research Article

Authors

Febblina Daryanes
0000-0001-5309-2461
Indonesia

Siti Zubaidah ^*
0000-0002-0718-6392
Indonesia

Susriyati Mahanal
0000-0001-5764-2184
Indonesia

Sulisetijono Sulisetijono
0000-0003-1066-3054
Indonesia

Early Pub Date

March 4, 2025

Publication Date

March 1, 2025

Submission Date

August 20, 2024

Acceptance Date

December 11, 2024

Published in Issue

Year 2025 Volume: 12 Number: 2

DOI

https://doi.org/10.17275/per.25.20.12.2

IZ

https://izlik.org/JA99LM75BK

APA

Daryanes, F., Zubaidah, S., Mahanal, S., & Sulisetijono, S. (2025). Development and Validation of Research Skills Instruments for Pre-service Biology Teachers. Participatory Educational Research, 12(2), 75-96. https://doi.org/10.17275/per.25.20.12.2

AMA

1.Daryanes F, Zubaidah S, Mahanal S, Sulisetijono S. Development and Validation of Research Skills Instruments for Pre-service Biology Teachers. PER. 2025;12(2):75-96. doi:10.17275/per.25.20.12.2

Chicago

Daryanes, Febblina, Siti Zubaidah, Susriyati Mahanal, and Sulisetijono Sulisetijono. 2025. “Development and Validation of Research Skills Instruments for Pre-Service Biology Teachers”. Participatory Educational Research 12 (2): 75-96. https://doi.org/10.17275/per.25.20.12.2.

EndNote

Daryanes F, Zubaidah S, Mahanal S, Sulisetijono S (March 1, 2025) Development and Validation of Research Skills Instruments for Pre-service Biology Teachers. Participatory Educational Research 12 2 75–96.

IEEE

[1]F. Daryanes, S. Zubaidah, S. Mahanal, and S. Sulisetijono, “Development and Validation of Research Skills Instruments for Pre-service Biology Teachers”, PER, vol. 12, no. 2, pp. 75–96, Mar. 2025, doi: 10.17275/per.25.20.12.2.

ISNAD

Daryanes, Febblina - Zubaidah, Siti - Mahanal, Susriyati - Sulisetijono, Sulisetijono. “Development and Validation of Research Skills Instruments for Pre-Service Biology Teachers”. Participatory Educational Research 12/2 (March 1, 2025): 75-96. https://doi.org/10.17275/per.25.20.12.2.

JAMA

1.Daryanes F, Zubaidah S, Mahanal S, Sulisetijono S. Development and Validation of Research Skills Instruments for Pre-service Biology Teachers. PER. 2025;12:75–96.

MLA

Daryanes, Febblina, et al. “Development and Validation of Research Skills Instruments for Pre-Service Biology Teachers”. Participatory Educational Research, vol. 12, no. 2, Mar. 2025, pp. 75-96, doi:10.17275/per.25.20.12.2.

Vancouver

1.Febblina Daryanes, Siti Zubaidah, Susriyati Mahanal, Sulisetijono Sulisetijono. Development and Validation of Research Skills Instruments for Pre-service Biology Teachers. PER. 2025 Mar. 1;12(2):75-96. doi:10.17275/per.25.20.12.2