Analysis of validity and reliability of the risk assessment form for children

Abstract

Objective: This study aimed to evaluate the psychometric parameters of an assessment tool developed by Turkish Ministry of Family and Social Services in 2024 to identify risks faced by children under vulnerable conditions.

Methods: In the research, the scientific validity and reliability of the "Risk Assessment Form for Children" were examined. The study was designed as a cross-sectional survey employing a quantitative approach. The sample was obtained by the simple random sampling method. Data were obtained from 418 children through the developed form.

Results: Data analysis was performed to assess the construct validity of the risk items, utilizing the Cronbach's alpha (α) value for reliability analysis. Factor analysis was used in the validity assessment. The form reveals an adequate distribution as determined by the explanatory factor analysis of the Kaiser-Meyer-Olkin test. Cronbach's alpha (α) was calculated to be 0.9. Six sub-dimensions have been identified. A robust consistency has been seen among the sub-dimensions of the shape.

Conclusion: The findings indicate that the Risk Assessment Form for Children comprises 46 components in total. The findings demonstrate that the form is a reliable measurement tool for assessing risks to children.

Keywords

• Vulnerable child
• risk factors
• validity
• reliability
• measurement

References

1. 1. Altuntaş O, Altınova HH. [Representation of Children at Risk in the Mainstream Media in Turkey]. Ergoterapi ve Rehabilitasyon Derg. 2015;3(2): 59-69. [Article in Turkish]
2. 2. Dönmez İ, Doğan H. [An Investıgation On Children At Risk (Example Of Muş)]. Adıyaman Üniversitesi Sosyal Bilimler Enstitüsü Derg. 2020;36:455-489. doi: 10.14520/adyusbd.720605. [Article in Turkish]
3. 3. Hillis S, Mercy J, Amobi A, Kress H. Global prevalence of past-year violence against children: A systematic review and minimum estimates. Pediatrics. 2016;137(3):e20154079. doi: 10.1542/peds.2015-4079.
4. 4. UNICEF. Child poverty: How many children live in poverty? UNICEF. https://www.unicef.org/social-policy/child-poverty. 2024.
5. 5. Save the Children (2022) Generation Hope: Standalone Summary [PDF] https://resourcecentre.savethechildren.net/pdf/Generation-Hope-standalone-Summary-Global-online-version-25-10-22.pdfhttps://resourcecentre.savethechildren.net/p8jywI6/. Access Date: 05.04.2024.
6. 6. World Health Organization (WHO). Child maltreatment. World Health Organization. Retrieved from. 2020. https://www.who.int/news-room/fact-sheets/detail/child-maltreatment.
7. 7. Nar C. 2020 orphan report. INSAMER. Retrieved from https://insamer.com/rsm/icerik/dosya/2928.pdf. 2020.
8. 8. [Ministry of Family and Social Services (ASHB). Evaluation Guide for Professionals Working in the Field of Child Protection]. 2024. https://www.aile.gov.tr/ [Article in Turkish]

9. 9. Aile ve Sosyal Hizmetler Bakanlığı (ASHB). 2023-2028 Türkiye çocuk hakları strateji belgesi ve eylem planı. 2023. https://www.aile.gov.tr/media/132816/turkiye-c-ocuk-haklari-strateji-belgesi-ve-eylem-plani-2023-2028-dijital.pdf. Access Date: 10.04.2024.
10. 10. Türkiye İstatistik Kurumu (TÜİK) & UNICEF. Türkiye’deki çocuklar 2023: İstatistiklere bakış. 2024.https://www.tuik.gov.tr/media/announcements/Turkiye_Cocuk_2023.pdf. Access Date: 1.04.2024.
11. 11. UNICEF. Child poverty: How many children live in poverty? UNICEF. https://www.unicef.org/social-policy/child-poverty. 2024. Access Date:1.04.2024.
12. 12. Bayındır N. [Views of Preservice Teachers on the Detection and Protection of Children at Risk]. 21. Yüzyılda Eğitim ve Toplum. 2021;10(28):187-202. [Article in Turkish]
13. 13. Elmacı F. [The School’s Role in Safeguardıng and Promotıng the Welfare Of Children: England Sample]. Türk Eğitim Bilimleri Derg. 2009;7(1):69-84. [Article in Turkish]
14. 14. Austin AE, Lesak AM, Shanahan ME. Risk and protective factors for child maltreatment: A review. Curr Epidemiol Rep. 2020;7(4): 334-342. doi: 10.1007/s40471-020-00252-3.
15. 15. Akkuş P. [Social Services for Children at Social Risk: An Assessment After 2000]. Çocuk ve Medeniyet. 2016;1(2):57-79. [Article in Turkish]
16. 16. UNHCR. The Heightened Risk Identification Tool User Guide. Switzerland: United Nations High Commissioner for Refugees. 2008.
17. 17. UNHCR. Outcome and Enabling Areas: Child Protection. Erişim Linki: https://reporting.unhcr.org/global-appeal-2024/outcome-and-enabling-areas/child-protection. 2024. Access Date: 04.04.2024.
18. 18. McNellan CR, Gibbs DJ, Knobel AS, Putnam-Hornstein E. The evidence base for risk assessment tools used in U.S. child protection investigations: A systematic scoping review. Child Abuse Negl. 2022;134:105887. doi: 10.1016/j.chiabu.2022.105887.
19. 19. D'Andrade A, Austin MJ, Benton A. Risk and safety assessment in child welfare: instrument comparisons. J Evid Based Soc Work. 2008;5(1-2):31-56. doi: 10.1300/J394v05n01_03.
20. 20. Tekindal M, Çalış N. Hassas koşullar altındaki çocukların tespiti (Özne Çocuk Projesi Raporu) https://oznecocuk.com/wp-content/uploads/2023/10/Faaliyet-4.1_Hassas-Kosullar-Altindaki-Cocuklarin-Tespiti_Approved-on-17072023.pdf. 2023. Access Date: 04.05.2024.
21. 21. Baker K. Assessment in Youth Justice: Professional Discretion and the Use of Asset in Youth. Justice. 2005;5(2):106-122. doi: 10.1177/147322540500500204.
22. 22. Ögel K, Yücesan S, Vaizoğlu Ç, et al. [Reliability and Validity of Personal Risk Assessment Form (BIRDEF) for Children Under Institutional Care]. Turkish J Clin Psy. 2016;19(2):60-72. doi: 10.5505/kpd.2016.38257. [Article in Turkish]
23. 23. Milli Eğitim Bakanlığı (2024). Rehberlik İhtiyacı Belirleme Anketi (RİBA). https://orgm.meb.gov.tr/. Access Date: 25.04.2024.
24. 24. Ercan İ, Kan İ. [Reliability and Validity in The Scales]. Uludağ Üniversitesi Tıp Fak Derg. 2004;30(3):211-216. [Article in Turkish]
25. 25. Yıldız A, Bütün M, Türkdoğan A, Kocak E. Development of a perception scale of private lesson: a validity and reliability study. Mimbar Sekolah Dasar. 2022;9(3):517-534. doi: 10.53400/mimbar-sd.v9i3.45144.
26. 26. DeVellis RF, Thorpe CT. Scale development: Theory and applications. 5th. ed., Sage Publications, Inc., 2022.
27. 27. Şişman FN, Ergün A, Sezer Balcı A. Psychometric properties of the Turkish version of the behavior assessment for children (BAC) scale. Curr Psychol. 2021;40(11):5678-5690. doi: 10.1007/s12144-021-02098-4.
28. 28. Gençtanırım D, Ergene T. [Development Risk Behaviours Scale: Vadility And Reliability Studies]. Int J Soc Sci. 2014;25(1):125-138. doi: 10.9761/JASSS2304. [Article in Turkish]
29. 29. Karakaya C, Özsavran M, Kurt A. The Social Exclusion Scale for Children (SESC): A Validity and Reliability Study in Turkish. J Soc Serv Res. 2024;50(5):771-783. doi: 10.1080/01488376.2024.2375518.
30. 30. Fakirullahoğlu AM, Köseoğlu A. [Validity and Reliability Study of the Attitudes Towards Bullying Scale for Children]. Humanistic Perspective. 2021;3(3):593-609. doi: 10.47793/hp.975578. [Article in Turkish]
31. 31. Aktu Y. [Adaptation of the Online Grooming Risk Scale To Turkish Culture]. Pamukkale Üniversitesi Sosyal Bilimler Enstitüsü Derg. 2024;62:369-378. doi: 10.30794/pausbed.1431239. [Article in Turkish]
32. 32. Azak M, Gözen D. Validity and Reliability of the Turkish Version of the Nutri STEP Questionnaire. CURAR Journal of Nursing. 2024;5:35-42. doi: 10.26650/CURARE.2024.1447500
33. 33. Ögel K, Karadayi G, Şenyuva G, Topsakal-Özdemir E. [Assessment of risks and needs of juvenile offenders: Development and Standardization of Examination and Assessment Form (ARDEF)]. Anadolu Psikiyatri Dergisi. 2011;12(2):143-150. [Article in Turkish]
34. 34. Miller J, Maloney C. Practitioner Compliance With Risk/Needs Assessment Tools: A Theoretical and Empirical Assessment. Crim Justice Behav. 2013;40(7):716-736. doi: 10.1177/0093854812468883
35. 35. Nethercott K. Assessment or referral tool: the unintended consequences of a dual purpose common assessment framework form. J Interprof Care. 2021;35(1):1-9. doi: 10.1080/13561820.2019.1705772.
36. 36. Vis SA, Lauritzen C. Child Protection Managers’ Views on Frameworks for Assessment of Children in Need. Child Care Pract. 2022;28(4):639-652. doi: 10.1080/13575279.2020.1816530.
37. 37. Tekindal M, Tekindal MA. Validity and Reliability of Basic Depression Scale For Turkey. Med J West Black Sea. 2021;5(3): 452-463. doi: 10.29058/mjwbs.906629.
38. 38. Cronbach LJ, Shavelson RJ. My current thoughts on coefficient alpha and successor procedures. Educ Psychol Meas. 2004;64(3):391-418. doi: 10.1177/0013164404266.
39. 39. Field A. Discovering statistics using SPSS. Thousand Oaks, CA, US. 2005: pp. 600-650.