Construct validity and reliability of the public health informatics competency scale for primary health care workers

Elif Saraç; Esra Yıldız

doi:10.20518/tjph.1629397

Construct validity and reliability of the public health informatics competency scale for primary health care workers

Abstract

Objective: Informatics competency is vital for public health care workers to meet the health-related needs of individuals with evidence-based practices through the field of science and engineering. The study was conducted to test the Turkish validity and reliability of the Public Health Informatics Competency for Primary Health Care Worker Scale.
Methods: Two hundred thirty one health care workers participated in the study, which was conducted between 25 April and 25 November 2023. The validity and reliability of the scale have been studied by conducting exploratory factor analysis, confirmatory factor analysis, internal consistency coefficients.
Results: As a result of the conducted analyses, the factor loadings varied between 0.293 and 0.808, explaining 37.2% of the total variance. Findings revealed that fit index analyses were at an acceptable level. For the scale, the single-factor structure containing 42 items was confirmed. Study found evidence for internal consistency as 0.956. Conclusion: The results showed that the instrument with the uni-dimensional structure meets the validity and reliability criteria. The scale can help clarify the informatics competency of primary health care workers. Within this frame, it could be said that the scale could make significant contributions to the literature.

Keywords

Ethical Statement

The study protocol was approved by Atatürk University Medical Faculty ethical board (7.09.2023-31). Informed consent forms from participants and consent from Enny Rachmani were received to test the 42-item PHIC4PHC by e-mail on the ResearchGate platform on 23.08.2023.

References

1. Farahat TM, Hegazy NN, Mowafy M. Information and communication technologies in primary healthcare facilities in Egypt. Prim Health Care Res Dev 2018;19(1):88-95.
2. Raghunathan K, McKenna L, Peddle M. Baseline evaluation of nursing students’ informatics competency for digital health practice: A descriptive exploratory study. Digit Health 2023;9:20552076231179051.
3. Montague E. The promises and challenges of health information technology in primary health care. Prim Health Care Res Dev 2014;15(3):227-30.
4. Rachmani E, Hsu CY, Chang PWS, Fuad A, Nurjanah N, Shidik GF, et al. Development and validation of an instrument for measuring competencies on public health informatics of primary health care worker (PHIC4PHC) in Indonesia. Prim Health Care Res Dev 2020;21:e22.
5. Aurore N, Valens M, Lune NJ, Nyssen M. Assessment of Health Informatics Competencies in Undergraduate Training of Healthcare Professionals in Rwanda. Rwanda J Med Health Sci 2016;3(1):37-43.
6. Gagne JC, Bisanar WA, Makowski JT, Neumann JL. Integrating informatics into the BSN curriculum: a review of the literature. Nurse Educ Today 2012;32(6):675-82.
7. Montague E. The promises and challenges of health information technology in primary health care. Prim Health Care Res Dev 2014;15(3):227-30.
8. Yoon S, Shaffer JA, Bakken S. Refining a self-assessment of informatics competency scale using Mokken scaling analysis. J Interprof Care 2015;29(6):579-86.

9. Elder BL, Koehn ML. Assessment tool for nursing student computer competencies. Nurs Educ Perspect 2009;30(3):148-52.
10. Rahman A. Development of a nursing informatics competency assessment tool (NICAT). [Doctoral dissertation]. Minneapolis: Walden University; 2015.
11. Kaynar NS, Secginli S, West K. Psychometric Testing of the Turkish Version of the Technology Informatics Guiding Educational Reform-Based Assessment of Nursing Informatics Competencies Tool. Comput Inform Nurs 2020;38(11):572-8.
12. Sarac E, Yildiz E. Development and Validation of Information Technology Scale in Nursing. Appl Clin Inform 2024;15(2):220-9.
13. Teke D, Sozbilir M. Developing a scale for self-efficacy of teacher training students in inclusive education environments. Eurasian J Teach Educ 2021;2(1):55-68.
14. Aravamudhan NR, Krishnaveni R. Establishing and reporting content validity evidence of new training and development capacity building scale (TDCBS). J Contemp Manag 2015;20(1):131-58.
15. Beran TN, Violato C. Structural equation modeling in medical research: a primer. BMC Res Notes 2010;3:267.
16. Li Y, Ji W, Chen H, Xie X, Yang J, Gao J. Psychometric properties of instruments used to measure the informatics competence of nurses: A systematic review. Nurse Educ Pract 2024;79:104070.
17. Farzandipour M, Mohamadian H, Akbari H, Safari S, Sharif R. Designing a national model for assessment of nursing informatics competency. BMC Med Inform Decis Mak 2021;21:35.
18. Karagöz Y. SPSS-AMOS-META Uygulamalı İstatistiksel Analizler. Ankara: Nobel Yayıncılık, 2019.
19. Lai MHC, Yoon M. A Modified Comparative Fit Index for Factorial Invariance Studies. Struct Equ Modeling 2015;22(2):236-48.
20. Kogar H, Kogar EY. Comparison of different estimation methods for categorical and ordinal data in confirmatory factor analysis. J Meas Eval Educ Psychol 2015;6(2):351-64.
21. Brown TA. Confirmatory Factor Analysis for Applied Research. 2nd ed. New York: Guilford Press, 2015.
22. Finney SJ, DiStefano C. Nonnormal and Categorical Data in Structural Equation Modeling. In: Hancock GR, Mueller RO, editors. Structural Equation Modeling: A Second Course. 2nd ed. Charlotte: Information Age Publishing; 2013. p.439-92.
23. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. 5th ed. Oxford: Oxford University Press, 2015.
24. Imhoff M, Webb A, Goldschimidt A. Health Informatics. Intensive Care Med 2001;27(1):179-86.
25. Fong SF, Ch'ng PE, Por FP. Development of ICT competency standard using the Delphi technique. Procedia Soc Behav Sci 2013;103:299-314.
26. Keller J, von der Gracht HA. The influence of information and communication technology (ICT) on future foresight processes-results from a Delphi survey. Technol Forecast Soc Change 2014;85:81-92.
27. Seo K, Min YH, Choi SH, Oh J, Chang H, Cha NR, et al. Evaluation of the Korean version of the self-assessment of nursing informatics competencies scale. BMC Nurs 2019;18:68.
28. Karagöz Y. SPSS Amos Meta Uygulamalı Nitel-Nicel-Karma Bilimsel Araştırma Yöntemleri ve Yayın Etiği. 3. Baskı. Ankara: Nobel Akademik Yayıncılık, 2021.
29. Vedel I, Lapointe L, Lussier MT, Richard C, Goudreau J, Lalonde L, et al. Healthcare professionals' adoption and use of a clinical information system (CIS) in primary care: insights from the Da Vinci study. Int J Med Inform 2012;81(2):73-87.
30. Sánchez-Mendiola M, Martínez-Franco AI, Rosales Vega A, Villamar-Chulin J, Gatica-Lara F, García Durán R, et al. Development and implementation of a biomedical informatics course for medical students: challenges of a large-scale blended-learning program. J Am Med Inform Assoc 2013;20(2):381-7.
31. Petty RE, Briñol P, Loersch C, McCaslin MJ. The need for cognition. In: Leary MR, Hoyle RH, editors. Handbook of Individual Differences in Social Behaviour. New York: Guilford Press; 2009. p.318-29.
32. Reise SP, Scheines R, Widaman KF, Haviland MG. Multidimensionality and structural coefficient bias in structural equation modeling: a bifactor perspective. Educ Psychol Meas 2013;73(1):5-26.
33. Chang J, Poynton MR, Gassert CA, Staggers N. Nursing informatics competencies required of nurses in Taiwan. Int J Med Inform 2011;80(5):332-40.
34. Yasnoff WA, O'Carroll PW, Koo D, Linkins RW, Kilbourne EM. Public health informatics: improving and transforming public health in the information age. J Public Health Manag Pract 2000;6(6):67-75.
35. Rachmani E, Haikal H, Rimawati E. Development and validation of digital health literacy competencies for citizens (DHLC), an instrument for measuring digital health literacy in the community. Comput Methods Programs Biomed Update 2022;2:100082.
36. Keller J, von der Gracht HA. The influence of information and communication technology (ICT) on future foresight processes-results from a Delphi survey. Technol Forecast Soc Change 2014;85:81-92.
37. Karagöz Y. SPSS Amos Meta Uygulamalı Nitel-Nicel-Karma Bilimsel Araştırma Yöntemleri ve Yayın Etiği. 3. Baskı. Ankara: Nobel Akademik Yayıncılık, 2021.
38. Phillips A, Yen PY, Kennedy M, Collins S. Opportunity and Approach for Implementation of a Self-Assessment Tool: Nursing Informatics Competencies for Nurse Leaders (NICA-NL). Stud Health Technol Inform 2017;232:207-11.

Details

Primary Language

English

Subjects

Public Health (Other)

Journal Section

Research Article

Authors

Elif Saraç ^*
0000-0002-4126-9327
Türkiye

Esra Yıldız
0000-0003-4445-7064
Türkiye

Publication Date

February 25, 2026

Submission Date

January 29, 2025

Acceptance Date

July 31, 2025

Published in Issue

Year 2026 Number: 1

DOI

https://doi.org/10.20518/tjph.1629397

IZ

https://izlik.org/JA25GN96AL

Cite

RIS / Bibtex

APA

Saraç, E., & Yıldız, E. (2026). Construct validity and reliability of the public health informatics competency scale for primary health care workers. Turkish Journal of Public Health, 1. https://doi.org/10.20518/tjph.1629397

AMA

1.Saraç E, Yıldız E. Construct validity and reliability of the public health informatics competency scale for primary health care workers. TJPH. 2026;(1). doi:10.20518/tjph.1629397

Chicago

Saraç, Elif, and Esra Yıldız. 2026. “Construct Validity and Reliability of the Public Health Informatics Competency Scale for Primary Health Care Workers”. Turkish Journal of Public Health, no. 1. https://doi.org/10.20518/tjph.1629397.

EndNote

Saraç E, Yıldız E (February 1, 2026) Construct validity and reliability of the public health informatics competency scale for primary health care workers. Turkish Journal of Public Health 1

IEEE

[1]E. Saraç and E. Yıldız, “Construct validity and reliability of the public health informatics competency scale for primary health care workers”, TJPH, no. 1, Feb. 2026, doi: 10.20518/tjph.1629397.

ISNAD

Saraç, Elif - Yıldız, Esra. “Construct Validity and Reliability of the Public Health Informatics Competency Scale for Primary Health Care Workers”. Turkish Journal of Public Health. 1 (February 1, 2026). https://doi.org/10.20518/tjph.1629397.

JAMA

1.Saraç E, Yıldız E. Construct validity and reliability of the public health informatics competency scale for primary health care workers. TJPH. 2026. doi:10.20518/tjph.1629397.

MLA

Saraç, Elif, and Esra Yıldız. “Construct Validity and Reliability of the Public Health Informatics Competency Scale for Primary Health Care Workers”. Turkish Journal of Public Health, no. 1, Feb. 2026, doi:10.20518/tjph.1629397.

Vancouver

1.Elif Saraç, Esra Yıldız. Construct validity and reliability of the public health informatics competency scale for primary health care workers. TJPH. 2026 Feb. 1;(1). doi:10.20518/tjph.1629397