TY  - JOUR
T1  - Development and Validation of Research Skills Instruments for Pre-service Biology Teachers
AU  - Zubaidah, Siti
AU  - Daryanes, Febblina
AU  - Mahanal, Susriyati
AU  - Sulisetijono, Sulisetijono
PY  - 2025
DA  - March
Y2  - 2024
DO  - 10.17275/per.25.20.12.2
JF  - Participatory Educational Research
JO  - PER
PB  - Özgen KORKMAZ
WT  - DergiPark
SN  - 2148-6123
SP  - 75
EP  - 96
VL  - 12
IS  - 2
LA  - en
AB  - Research skills are essential for navigating the demands of the 21st century, as they allow students to become accustomed to doing critical analysis in a productive context to uncover knowledge and solutions and boost their future career prospects. However, there are still relatively few studies that develop research skills instruments. This study aims to fill the gap by developing and validating the research skills instruments. We developed and validated a research skills instrument using expert ratings of biology education and surveys. The survey was conducted on 408 respondents, namely pre-service biology teachers. Data were analyzed through descriptive analysis, Exploratory Factor Analysis (EFA), followed by Confirmatory Factor Analysis (CFA) calculated to validate and confirm the final dimensions of the newly developed instrument. This series of analysis produces 22 statement items with four dimensions, namely Embark & Clarify (EmC), composed of seven items; Find & Manage (FM), consisting of six items; Identify & Generate (IG), composed of four items; Evaluate & Communicate (EvC) consisting of five items. The CFA results match the proposed model to observational data. The study indicate that the dimension that best describes students’ research skills is Evaluate & Communicate. The research skills instrument developed has an adequate internal consistency value, indicating that it can be used to assess student research skills. This study recommends a research skills instrument to evaluate students' research skills to produce graduates with scientific skills.
KW  - dimensions of research skills
KW  - preservice biology teacher students
KW  - psychometric analysis
CR  - Abbott, D. (2019). Game-based learning for postgraduates: An empirical study of an educational game to teach research skills. Higher Education Pedagogies, 4(1), 80–104. https://doi.org/10.1080/23752696.2019.1629825
CR  - Ain, C. T., Sabir, F., & Willison, J. (2019). Research skills that men and women developed at university and then used in workplaces. Studies in Higher Education, 44(12), 2346–2358. https://doi.org/10.1080/03075079.2018.1496412
CR  - Asghar, A. U. R., Aksoy, M., Graham, A. I., & Baseler, H. A. (2023). Developing research skills in medical students online using an active research study. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04781-5
CR  - Awodoyin, A. F., Adetoro, N., & Oke, P. (2021). Perceived research skills of graduating library and information science (LIS) undergraduates in a Nigerian University of Education. Library Philosophy & Practice, 1–23. http://pbidi.unam.mx:8080/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=edo&AN=153746229&lang=es&site=eds-live
CR  - Bandaranaike, S. (2018). From research skill development to work skill development. Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.7
CR  - Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment and Evaluation in Higher Education, 38(6), 698–712. https://doi.org/10.1080/02602938.2012.691462
CR  - Brezavšček, A., Šparl, P., & Žnidaršič, A. (2017). Factors influencing the behavioural intention to use statistical software: The perspective of the Slovenian students of social sciences. Eurasia Journal of Mathematics, Science and Technology Education, 13(3), 953–986. https://doi.org/10.12973/eurasia.2017.00652a
CR  - Bueno, D. (2017). Research Skills of the Professorial Lecturers: Input to Capability Building. JPAIR Institutional Research, 9(9), 1–17. https://doi.org/10.7719/irj.v9i9.489
CR  - Carberry, C., McCombe, G., Tobin, H., Stokes, D., Last, J., Bury, G., & Cullen, W. (2021). Curriculum initiatives to enhance research skills acquisition by medical students: a scoping review. BMC Medical Education, 21(1), 1–13. https://doi.org/10.1186/s12909-021-02754-0
CR  - Carrió, M., Baños, J.-E., & Rodríguez, G. (2022). Comparison of the Effect of Two Hybrid Models of Problem-Based Learning Implementation on the Development of Transversal and Research Skills and the Learning Experience. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.875860
CR  - Castillo-Martínez, I. M., & Ramírez-Montoya, M. S. (2021). Research Competencies to Develop Academic Reading and Writing: A Systematic Literature Review. Frontiers in Education, 5(January), 1–12. https://doi.org/10.3389/feduc.2020.576961
CR  - Corchon, S., Watson, R., Arantzamendi, M., & Saracíbar, M. (2010). Design and validation of an instrument to measure nursing research culture: The Nursing Research Questionnaire (NRQ). Journal of Clinical Nursing, 19(1–2), 217–226. https://doi.org/10.1111/j.1365-2702.2009.03049.x
CR  - Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Pearson Education: In Educational Research.
CR  - Damopolii, I., Botutihe, V. T., & Nunaki, J. H. (2019). The contribution of science process skill towards students cognitive achievement through guided inquiry-based learning. Journal of Physics: Conference Series, 1317(1). https://doi.org/10.1088/1742-6596/1317/1/012184
CR  - Delgado, C. L. P., & Estrada, L. (2022). Pedagogical Conditions and Challenges for the Development of Research Skills. Revista Electronica de Investigacion Educativa, 24. https://doi.org/10.24320/redie.2022.24.e09.3937
CR  - Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in Second Language Research. New York: Routledge.
CR  - Galvez, G., Killilea, D. W., Berry, S., Narayanaswami, V., & Fung, E. B. (2024). Increasing STEM Skills, Knowledge and Interest Among Diverse Students: Results from an Intensive Summer Research Program at the University of California, San Francisco. Innovative Higher Education, February. https://doi.org/10.1007/s10755-024-09701-z
CR  - George-Reyes, C. E., López-Caudana, E. O., & Ramírez-Montoya, M. S. (2023). Research competencies in university students: Intertwining complex thinking and Education 4.0. Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13767
CR  - Gyuris, E. (2018). Evaluating the effectiveness of postgraduate research skills training and its alignment with the research skill development framework. Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.5
CR  - Heikkilä, M., Hermansen, H., Iiskala, T., Mikkilä-Erdmann, M., & Warinowski, A. (2023). Epistemic agency in student teachers’ engagement with research skills. Teaching in Higher Education, 28(3), 455–472. https://doi.org/10.1080/13562517.2020.1821638
CR  - Hendriarto, P., Mursidi, A., Kalbuana, N., Aini, N., & Aslan, A. (2021). Understanding the Implications of Research Skills Development Framework for Indonesian Academic Outcomes Improvement. Jurnal Iqra’ : Kajian Ilmu Pendidikan, 6(2), 51–60. https://doi.org/10.25217/ji.v6i2.1405
CR  - Hoffmeister, T., Koch, H., & Tremp, P. (2020). Forschendes Lernen als Studiengangsprofil. Germany: Springer Vs.
CR  - Hordern, J. (2019). Knowledge, evidence, and the configuration of educational practice. Education Sciences, 9(2). https://doi.org/10.3390/educsci9020070
CR  - Hughes, G. (2019). Developing student research capability for a ‘post-truth’ world: three challenges for integrating research across taught programmes. Teaching in Higher Education, 24(3), 394–411. https://doi.org/10.1080/13562517.2018.1541173
CR  - Kelly, S. L. (2019). Faculty perceptions of librarian value: The moderating relationship between librarian contact, course goals, and students’ research skills. Journal of Academic Librarianship, 45(3), 228–233. https://doi.org/10.1016/j.acalib.2019.03.003
CR  - Khalaf, M. A., & Alshammari, A. (2023). Effects of Project-Based Learning on Postgraduate Students’ Research Proposal Writing Skills. European Journal of Educational Research, 12(1), 189–200. https://doi.org/10.12973/eu-jer.12.1.189
CR  - Lee, M. G. Y., Hu, W. C. Y., & Bilszta, J. L. C. (2020). Determining Expected Research Skills of Medical Students on Graduation: a Systematic Review. Medical Science Educator, 30(4), 1465–1479. https://doi.org/10.1007/s40670-020-01059-z
CR  - Leupen, S. M., Kephart, K. L., & Hodges, L. C. (2020). Factors influencing quality of team discussion: Discourse analysis in an undergraduate team-based learning biology course. CBE Life Sciences Education, 19(1). https://doi.org/10.1187/cbe.19-06-0112
CR  - Maddens, L., Depaepe, F., Janssen, R., Raes, A., & Elen, J. (2020). Evaluating the Leuven Research Skills Test for 11th and 12th Grade. Journal of Psychoeducational Assessment, 38(4), 445–459. https://doi.org/10.1177/0734282918825040
CR  - Mahanal, S., Zubaidah, S., Setiawan, D., Maghfiroh, H., & Muhaimin, F. G. (2022). Empowering College Students’ Problem-Solving Skills through RICOSRE. Education Sciences, 12(3). https://doi.org/10.3390/educsci12030196
CR  - Mahanal, S., Zubaidah, S., Sumiati, I. D., Sari, T. M., & Ismirawati, N. (2019). RICOSRE: A learning model to develop critical thinking skills for students with different academic abilities. International Journal of Instruction, 12(2), 417–434. https://doi.org/10.29333/iji.2019.12227a
CR  - Mahasneh, O. M. (2020). The effectiveness of flipped learning strategy in the development of scientific research skills in procedural research course among higher education diploma students. Research in Learning Technology, 28(1063519), 1–17. https://doi.org/10.25304/rlt.v28.2327
CR  - Mallidou, A. A., Borycki, E., Frisch, N., & Young, L. (2018). Research competencies assessment instrument for nurses: Preliminary psychometric properties. Journal of Nursing Measurement, 26(3), E159–E177. https://doi.org/10.1891/1061-3749.26.3.E159
CR  - Marlina, R., Suwono, H., Yuenyong, C., Ibrohim, I., Mahanal, S., Saefi, M., & Hamdani, H. (2023). Technological Pedagogical Content Knowledge (TPACK) for Pre-service Biology Teachers: Two Insights More Promising. Participatory Educational Research, 10(6), 245–265. https://doi.org/10.17275/per.23.99.10.6
CR  - Mataniari, R., Willison, J., Hasibuan, M. H. E., Sulistiyo, U., & Dewi, F. (2020). Portraying students’ critical thinking skills through research skill development (RSD) framework: A case of a biology course in an Indonesian University. Journal of Turkish Science Education, 17(2), 302–314. https://doi.org/10.36681/tused.2020.28
CR  - Meerah, T. S. M., Osman, K., Zakaria, E., Ikhsan, Z. H., Krish, P., Lian, D. K. C., & Mahmod, D. (2012). Developing an Instrument to Measure Research Skills. Procedia - Social and Behavioral Sciences, 60, 630–636. https://doi.org/10.1016/j.sbspro.2012.09.434
CR  - Meissner, D., & Shmatko, N. (2019). Integrating professional and academic knowledge: the link between researchers skills and innovation culture. Journal of Technology Transfer, 44(4), 1273–1289. https://doi.org/10.1007/s10961-018-9662-8
CR  - Meyers, L., Gamst, G., & Guarino, A. . (2017). Applied Multivariate Research. SAGE.
CR  - Mora-López, N., & Bernárdez-Vilaboa, R. (2023). Exploratory Study on the Blended Learning of Research and Language Skills in EFL and Interinstitutional Assessment. Education Sciences, 13(2). https://doi.org/10.3390/educsci13020155
CR  - Noguez, J., & Neri, L. (2019). Research-based learning: a case study for engineering students. International Journal on Interactive Design and Manufacturing, 13(4), 1283–1295. https://doi.org/10.1007/s12008-019-00570-x
CR  - Opitz, A., Heene, M., & Fischer, F. (2017). Measuring scientific reasoning–a review of test instruments. Educational Research and Evaluation, 23(3–4), 78–101. https://doi.org/10.1080/13803611.2017.1338586
CR  - Peiró-Signes, Á., Trull, O., Segarra-Oña, M., & García-Díaz, J. C. (2021). Anxiety towards statistics and its relationship with students’ attitudes and learning approach. Behavioral Sciences, 11(3). https://doi.org/10.3390/bs11030032
CR  - Perez, A., Rabionet, S., & Bleidt, B. (2017). Teaching research skills to student pharmacists in one semester: An applied research elective. American Journal of Pharmaceutical Education, 81(1). https://doi.org/10.5688/ajpe81116
CR  - Qiu, C., Feng, X., Reinhardt, J. D., & Li, J. (2019). Development and psychometric testing of the Research Competency Scale for Nursing Students: An instrument design study. Nurse Education Today, 79(37), 198–203. https://doi.org/10.1016/j.nedt.2019.05.039
CR  - Rodrigues, I. B., Adachi, J. D., Beattie, K. A., & MacDermid, J. C. (2017). Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskeletal Disorders, 18(1), 1–9. https://doi.org/10.1186/s12891-017-1914-5
CR  - Rodríguez, G., Pérez, N., Núñez, G., Baños, J. E., & Carrió, M. (2019). Developing creative and research skills through an open and interprofessional inquiry-based learning course. BMC Medical Education, 19(1), 1–13. https://doi.org/10.1186/s12909-019-1563-5
CR  - Saefi, M., Fauzi, A., Kristiana, E., Adi, W. C., Muchson, M., Setiawan, M. E., Islami, N. N., Fitria Ningrum, D. E. A., Ikhsan, M. A., & Ramadhani, M. (2020). Validating of Knowledge, Attitudes, and Practices Questionnaire for Prevention of COVID-19 infections among Undergraduate Students: A RASCH and Factor Analysis. Eurasia Journal of Mathematics, Science and Technology Education, 16(12), 1–14. https://doi.org/10.29333/ejmste/9352
CR  - Suwono, H., Maulidia, L., Saefi, M., Kusairi, S., & Yuenyong, C. (2022). The Development and Validation of an Instrument of Prospective Science Teachers’ Perceptions of Scientific Literacy. Eurasia Journal of Mathematics, Science and Technology Education, 18(1). https://doi.org/10.29333/EJMSTE/11505
CR  - Swank, J. M., & Lambie, G. W. (2016). Development of the Research Competencies Scale. Measurement and Evaluation in Counseling and Development, 49(2), 91–108. https://doi.org/10.1177/0748175615625749
CR  - Tabachnick, B, G., & Fidell, L. S. (2007). Using Multivariate Statistics. California: Pearson.
CR  - Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics. In Contemporary Psychology: A Journal of Reviews (Vol. 28, Issue 8). United States of America: Pearson Education. https://doi.org/10.1037/022267
CR  - Tajuria, G., Dobel-Ober, D., Bradley, E., Charnley, C., Lambley-Burke, R., Mallen, C., Honeyford, K., & Kingstone, T. (2024). Evaluating the impact of the supporting the advancement of research skills (STARS) programme on research knowledge, engagement and capacity-building in a health and social care organisation in England. BMC Medical Education, 24(1). https://doi.org/10.1186/s12909-024-05059-0
CR  - Torres, L. (2018). Research skills in the first-year biology practical - Are they there? Journal of University Teaching and Learning Practice, 15(4). https://doi.org/10.53761/1.15.4.3
CR  - Willison, J., & Pijlman, F. B. (2016). PhD prepared: research skill development across the undergraduate years. International Journal for Researcher Development, 7(1), 63–83. https://doi.org/10.1108/ijrd-07-2015-0018
CR  - Zapata, M. I., Quiñones, J. F., Palacios, J. B., Inca, W. A., Negrete, M. Q., & Zegarra, D. V. (2023). Research skills for university students’ thesis in E-learning: Scale development and validation in Peru. Heliyon, 9(3). https://doi.org/10.1016/j.heliyon.2023.e13770
CR  - Zubaidah, S., Corebima, A. D., Mahanal, S., & Mistianah. (2018). Revealing the relationship between reading interest and critical thinking skills through remap GI and remap jigsaw. International Journal of Instruction, 11(2), 41–56. https://doi.org/10.12973/iji.2018.1124a
CR  - Zubaidah, S., Mahanal, S., Rosyida, F., Kurniawati, Z. L., Sholihah, M., & Ismirawati, N. (2018). Using remap-TmPS learning to improve low-ability students’ critical thinking skills. Asia-Pacific Forum on Science Learning and Teaching, 19(1).
UR  - https://doi.org/10.17275/per.25.20.12.2
L1  - https://dergipark.org.tr/en/download/article-file/4157143
ER  -