Validity and reliability study of the Turkish version of the Short Executive Functioning Scale

Abstract

The present study aimed to adapt the Short Executive Functioning Scale, originally developed by Palmer et al. (2024), into Turkish and examine its psychometric properties in a preschool population. The sample consisted of 266 children aged between 36 and 82 months, all of whom were enrolled in early childhood education. The Turkish version included 12 items, and confirmatory factor analysis results supported the original two-factor model. To assess criterion-related validity, the Childhood Executive Function Inventory–Parent Form was administered, yielding statistically significant correlations. Test-retest reliability coefficients were found to be .62 for executive function skills and .32 for executive function difficulties. Corrected item-total correlations ranged between .268 and .458. Overall, the findings suggest that the Turkish version of the Short Executive Functioning Scale is a valid and reliable instrument for assessing executive function abilities in preschool-aged children.

Keywords

• Executive functions
• Rating scale
• Preschool children

Project Number

Bu araştırma Balıkesir Üniversitesi Bilimsel Araştırma Projeleri Birimi tarafından desteklenmiştir. Proje Numarası: 2024/077

Kısa Yürütücü İşlevler Ölçeği (Short Executive Functioning Scale) Türkçe formunun geçerlik ve güvenirlik çalışması

Abstract

Bu çalışmanın amacı, Palmer vd. (2024) tarafından geliştirilen Kısa Yürütücü İşlevler Ölçeği’nin Türkçe formunun uyarlanmasını sağlamak ve bu formun geçerlik ve güvenirlik özelliklerini değerlendirmektir. Araştırmanın çalışma grubunu, 36-82 aylık 266 okul öncesi çocuk oluşturmuştur. Türkçe formda toplam 12 madde yer almakta olup, doğrulayıcı faktör analizi bulguları, ölçeğin özgün iki boyutlu yapısını desteklemiştir. Ölçüt bağıntılı geçerliği değerlendirmek amacıyla uygulanan Çocukluk Dönemi Yürütücü İşlevler Envanteri (Ebeveyn Formu) ile anlamlı korelasyonlar elde edilmiştir. Test-tekrar test yöntemiyle hesaplanan güvenirlik katsayıları sırasıyla .62 ve .32 olarak bulunmuştur. Ayrıca, düzeltilmiş madde-toplam korelasyon katsayıları .268 ile .458 arasında değişmektedir. Bulgular, Kısa Yürütücü İşlevler Ölçeği’nin geçerli ve güvenilir olduğunu ve okul öncesi dönem çocukların yürütücü işlev becerilerinin değerlendirebilecek bir araç olduğunu göstermektedir.

Keywords

• Yürütücü işlevler
• Derecelendirme ölçeği
• Okul öncesi çocukları

Supporting Institution

Bu araştırma Balıkesir Üniversitesi Bilimsel Araştırma Projeleri Birimi tarafından desteklenmiştir. Proje Numarası: 2024/077

Project Number

Bu araştırma Balıkesir Üniversitesi Bilimsel Araştırma Projeleri Birimi tarafından desteklenmiştir. Proje Numarası: 2024/077

References

1. Allan, N. P. ve Lonigan, C. J. (2014). Exploring dimensionality of effortful control using hot and cool tasks in a sample of preschool children. Journal of Experimental Child Psychology, 122, 33–47. https://doi.org/10.1016/j.jecp.2013.11.013
2. Anzulewicz, A., Sobota, K. ve Delafield-Butt, J. T. (2016). Toward the Autism Motor Signature: Gesture patterns during smart tablet gameplay identify children with autism. Scientific Reports, 6(1), 31107. https://doi.org/10.1038/srep31107
3. Arslan-Çiftçi, H., Uyanık, G. ve Acar, İ.H. (2020). Çocukluk dönemi yürütücü işlevler envanteri Türkçe formunun 48-72 aylık çocuklar için geçerlik ve güvenirlik çalışması. Erken Çocukluk Çalışmaları Dergisi, 4(3), 762-787. https://doi.org/10.24130/eccd-jecs.1967202043260
4. Barkley, R. A. (1997). Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. Psychological Bulletin, 121(1), 65-94. https://doi.org/10.1037/0033-2909.121.1.65
5. Batan, S. N., Öktem-Tanör, Ö. ve Kalem, E. (2011). Reliability and validity studies of Behavioral Rating Inventory of Executive Function (BRIEF) in a Turkish normative sample. Elementary Education Online, 10(3), 894-904.
6. Beck, D. M., Schaefer, C., Pang, K. ve Carlson, S. M. (2011). Executive function in preschool children: Test–retest reliability. Journal of Cognition and Development, 12(2), 169–193. https://doi.org/10.1080/15248372.2011.563485 Bentler, P. M. (1995). EQS Structural Equations Program Manual. Multivariate Software.
7. Bhavnani, S., Mukherjee, D., Bhopal, S., Sharma, K. K., Dasgupta, J., Divan, G., Soremekun, S., Roy, R., Kirkwood, B. ve Patel, V. (2021). The association of a novel digital tool for assessment of early childhood cognitive development, ‘Developmental assessment on an E- Platform (DEEP)’, with growth in rural India: A proof of concept study. EClinicalMedicine, 37, 100964. https://doi.org/10.1016/j.eclinm.2021.100964
8. Bhavnani, S., Mukherjee, D., Dasgupta, J., Verma, D., Parameshwaran, D., Divan, G., Sharma, K. K., Thiagarajan, T. ve Patel, V. (2019). Development, feasibility, and acceptability of a gamified cognitive Developmental assessment on an E- Platform (DEEP) in rural Indian pre-schoolers- a pilot study. Global Health Action, 12(1), 1548005. https://doi.org/10.1080/16549716.2018.1548005

9. Blair, C. ve Razza, R. P. (2007). Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Development, 78(2), 647–663. https://doi.org/10.1111/j.1467-8624.2007.01019.x
10. Browne, M. W. ve Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21, 230-258. https://doi.org/10.1177/0049124192021002005
11. Büyüköztürk, Ş., Akgün, Ö. E., Özkahveci, Ö. ve Demirel, F. (2004). Güdülenme ve Öğrenme Stratejileri Ölçeği’nin Türkçe formunun geçerlik ve güvenirlik çalışması. Kuram ve Uygulamada Eğitim Bilimleri, 4(2), 207-239.
12. Cameron, C. E., McClelland, M. M., Kwan, T., Starke, K. ve Lewis-Jones, T. (2024). HTKS- Kids: A tablet-based self-regulation measure to equitably assess young children’s school readiness. Frontiers in Psychology, 14, 1202239. https://doi.org/10.3389/fpsyg.2023.1202239
13. Carlson, S. M., Davis, A. C. ve Leach, J. G. (2005). Less is more: Executive function and symbolic representation in preschool children. Psychological Science, 16(8), 609–616. https://doi.org/10.1111/j.1467-9280.2005.01583.x
14. Carlson, S. M., Zelazo, P. D. ve Faja, S. (2013). Executive function. In P. D. Zelazo (Ed.), The Oxford handbook of developmental psychology (Vol. 1): Body and mind (pp. 706–743). Oxford University Press. Clark, L. A. ve Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://doi.org/10.1037/14805-012
15. Courage, M. L., Frizzell, L. M., Walsh, C. S. ve Smith, M. (2021). Toddlers using tablets: They engage, play, and learn. Frontiers in Psychology, 12, 564479. https://doi.org/10.3389/fpsyg.2021.564479
16. Çokluk, Ö. S., Şekercioğlu, G. ve Büyüköztürk, S. (2012). Sosyal bilimler için çok değişkenli istatistik: SPSS ve Lisrel uygulamaları. Pegem Akademi Yayıncılık.
17. Çorapçı, F., Aksan, N., Arslan-Yalçın, D. ve Yağmurlu, B. (2010). Okul öncesi dönemde duygusal, davranışsal ve sosyal uyum taraması: Sosyal Yetkinlik ve Davranış Değerlendirme-30 Ölçeği. Çocuk ve Gençlik Ruh Sağlığı Dergisi, 17, 3-14.
18. Denckla, M. B. (2002). The Behavior Rating Inventory of Executive Function: Commentary. Child Neuropsychology, 8, 304–306. https://doi.org/10.1076/chin.8.4.304.13512
19. Denham, S. A., Ferrier, D. E. ve Bassett, H. H. (2020). Preschool teachers’ socialization of emotion knowledge: considering socioeconomic risk. Journal of Applied Developmental Psychology, 69, 101160. https://doi.org/10.1016/j.appdev.2020.101160
20. DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Sage Publications.
21. Diamond, A. (2012). Activities and programs that improve children’s executive functions. Current Directions in Psychological Science, 21, 335–341. https://doi.org/10.1177/0963721412453722
22. Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. https://doi.org/10.1146/annurev-psych-113011-143750
23. Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., Pagani, L. S., Feinstein, L., Engel, M., Brooks-Gunn, J., Sexton, H., Duckworth, K. ve Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43(6), 1428–1446. https://doi.org/10.1037/0012-1649.43.6.1428
24. Eng, C. M., Tsegai-Moore, A. ve Fisher, A. V. (2024). Incorporating evidence-based gamification and machine learning to assess preschool executive function: A feasibility study. Brain Sciences, 14(5), 451. https://doi.org/10.3390/brainsci14050451
25. Frye, D., Zelazo, P. D. ve Palfai, T. (1995). Theory of mind and rule-based reasoning. Cognitive Development, 10(4), 483–527. https://doi.org/10.1016/0885-2014(95)90024-1
26. Fuhs, M. W., Nesbitt, K. T., Farran, D. C. ve Dong, N. (2014). Longitudinal associations between executive functioning and academic skills across content areas. Developmental Psychology, 50(6), 1698–1709. https://doi.org/10.1037/a0036633
27. George, D. ve Mallery, P. (2019). IBM SPSS Statistics 26 step by step: A simple guide and reference (16th ed.). Routledge.
28. Gioia, G. A., Isquıth, P. K., Guy, S. C. ve Kenworthy, L. (2000). BRIEF: Behavioral Rating Inventory of Executive Function Professional Manual, Odessa, Florida, Psychological Assessment Resources.
29. Gioia, G. A., Isquith, P. K. ve Kenealy, L. E. (2008). Assessment of behavioral aspects of executive function. In V. Anderson, R. Jacobs, & P. J. Anderson (Eds.), Executive functions and the frontal lobes: A lifespan perspective (pp. 179–202). Taylor & Francis.
30. Hamamcı, B., Acar, İ. ve Uyanık, G. (2021). Validity and reliability study of parent report of the childhood executive functioning inventory for preschoolers. Eğitimde Kuram ve Uygulama, 17(2), 1-10. https://doi.org/10.17244/eku.884918
31. Hatzigianni, M. ve Kalaitzidis, I. (2018). Early childhood educators' attitudes and beliefs around the use of touchscreen technologies by children under three years of age. British Journal of Educational Technology, 49(5), 883-895. https://doi.org/10.1111/bjet.12649
32. Howard, S. J. ve Melhuish, E. (2017). An early years toolbox for assessing early executive function, language, self-regulation, and social development: Validity, reliability, and preliminary norms. Journal of Psychoeducational Assessment, 35(3), 255-275. https://doi.org/10.1177/073428291663300
33. Hu, L.-T. ve Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76–99). Sage Publications, Inc.
34. Istepanian R. S. H. ve AlAnzi T. (2020). Mobile health (m-health): Evidence-based progress or scientific retrogression. In Dagan Feng D. (ed.), Biomedical information technology (2nd ed., pp. 717–733). Academic press. https://doi.org/10.1016/b978-0-12-816034-3.00022-5
35. Jacques, S. ve Zelazo, P. D. (2001). The Flexible Item Selection Task (FIST): A measure of executive function in preschoolers. Developmental Neuropsychology, 20(3), 573–591.
36. JASP Team (2024). JASP (Version 0.19.1) [Computer software].
37. Karakelle, S. ve Ertuğrul, Z. (2012). Zihin kuramı ile çalışma belleği, dil becerisi ve yönetici işlevler arasındaki bağlantılar küçük (36-48 ay) ve büyük (53-72 ay) çocuklarda farklılık gösterebilir mi? Türk Psikoloji Dergisi, 27(70), 1–21.
38. Karasar, N. (2014). Bilimsel araştırma yöntemi “kavramlar ilkeler teknikler”. 26. Basım. Nobel Akademik.
39. Kline, R. B. (2005). Principles and practice of structural equation modeling. The Guilford Press.
40. Kochanska, G., Murray, K., Jacques, T. Y., Koenig, A. L. ve Vandegeest, K. A. (1996). Inhibitory control in young children and its role in emerging internalization. Child development, 67(2), 490-507. https://doi.org/10.1111/j.1467-8624.1996.tb01747.x
41. Loewenthal, K. M. (2004). An introduction to psychological tests and scales (2. baskı). Psychology Press. MacCallum, R. C., Browne, M. W. ve Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. https://doi.org/10.1037/1082-989X.1.2.130
42. Marsh, H. W., Balla, J. R. ve McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103(3), 391–410. https://doi.org/10.1037/0033-2909.103.3.391 Masten, A. S., Herbers, J. E., Desjardins, C. D., Cutuli, J. J., McCormick, C. M., Sapienza, J. K. Long J.D. ve Zelazo, P. D. (2012). Executive function skills and school success in young children experiencing homelessness. Educational Researcher, 41(9), 375–384. https://doi.org/10.3102/0013189X12459883
43. McClelland, M. M., Cameron, C. E., Connor, C. M., Farris, C. L., Jewkes, A. M. ve Morrison, F. J. (2007a). Links between behavioral regulation and preschoolers’ literacy, vocabulary, and math skills. Developmental Psychology, 43(4), 947–959. https://doi.org/10.1037/0012-1649.43.4.947
44. McClelland, M. M., Cameron, C. E., Wanless, S. B. ve Murray, A. (2007b). Executive function, behavioral self-regulation, and social-emotional competence. In O. N. Saracho & B. Spodek (Eds.), Contemporary perspectives on social learning in early childhood education (pp. 83–107). Information Age.
45. McHenry, M. S., Mukherjee, D., Bhavnani, S., Kirolos, A., Piper, J. D., Crespo-Llado, M. M. ve Gladstone, M. J. (2023). The current landscape and future of tablet-based cognitive assessments for children in low-resourced settings. PLOS Digital Health, 2(2), e0000196. https://doi.org/10.1371/journal.pdig.0000196
46. Meixner, J. M. ve Laubrock, J. (2024). Executive functioning predicts development of reading skill and perceptual span seven years later. Journal of Memory and Language, 136, 104511. https://doi.org/10.1016/j.jml.2024.104511
47. Meuwissen, A. S. ve Zelazo, P. D. (2014). Hot and cool executive function: Foundations for learning and healthy development. Zero to Three, 35(2), 18–23.
48. Millar, L., McConnachie, A., Minnis, H., Wilson, P., Thompson, L., Anzulewicz, A., Sobota, K., Rowe, P., Gillberg, C. ve Delafield-Butt, J. (2019). Phase 3 diagnostic evaluation of a smart tablet serious game to identify autism in 760 children 3-5 years old in Sweden and the United Kingdom. BMJ Open, 9(7), Article e026226. https://doi.org/10.1136/bmjopen-2018-026226
49. Miyake, A. ve Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14. https://doi.org/10.1177/0963721411429458
50. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H. ve Howerter, A. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734
51. Naglieri, J. A. ve Goldstein, S. (2014). Using the Comprehensive Executive Function Inventory (CEFI) to assess executive function: From theory to application. In J. A. Naglierive S. Goldstein, Handbook of executive functioning (pp. 223-244). Springer.
52. Neitzel, J. (2018). What measures of program quality tell us about the importance of executive function: Implications for teacher education and preparation. Journal of Early Childhood Teacher Education, 39(3), 181–192. https://doi.org/10.1080/10901027.2018.1457580
53. Nguyen, T. ve Duncan, G. J. (2019). Kindergarten components of executive function and third grade achievement: A national study. Early Childhood Research Quarterly, 46, 49–61. https://doi.org/10.1016/j.ecresq.2018.05.006
54. Obradović, J. (2010). Effortful control and adaptive functioning of homeless children: Variable-focused and person-focused analyses. Journal of Applied Developmental Psychology, 31(2), 109–117. https://doi.org/10.1016/j.appdev.2009.09.004
55. Obradović, J. ve Willoughby, M. T. (2019). Studying executive function skills in young children in low‐and middle‐income countries: Progress and directions. Child Development Perspectives, 13(4), 227–234. https://doi.org/10.1111/cdep.12349
56. Palmer, A. R., Kalstabakken, A.W., Distefano, R., Carlson, S. M., Putnam, S. P. ve Masten, A. S. (2024). A short executive functioning questionnaire in the context of early childhood screening: Psychometric properties. Child Neuropsychology, 1-30. https://doi.org/10.1080/09297049.2024.2329435
57. Prencipe, A., Kesek, A., Cohen, J., Lamm, C., Lewis, M. D. ve Zelazo, P. D. (2011). Development of hot and cool executive function during the transition to adolescence. Journal of Experimental Child Psychology, 108(3), 621-637. https://doi.org/10.1016/j.jecp.2010.09.008
58. Prencipe, A. ve Zelazo, P. D. (2005). Development of affective decision making for self and other: Evidence for the integration of first-and third-person perspectives. Psychological Science, 16(7), 501-505. https://doi.org/10.1111/j.0956-7976.2005.01564.x
59. Putnick, D. L. ve Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
60. Schmitt, S. A., Geldhof, G. J., Purpura, D. J., Duncan, R. ve McClelland, M. M. (2017). Examining the relations between executive function, math, and literacy during the transition to kindergarten: A multi-analytic approach. Journal of Educational Psychology, 109(8), 1120–1140. https://doi.org/10.1037/edu0000193
61. Schumacker, E. R. ve Lomax, G. R. (1996). A beginner's guide to structural equation modeling. Lawrence Erlbaum Associates.
62. Steenbergen‐Hu, S., Olszewski‐Kubilius, P. ve Calvert, E. (2017). PROTOCOL: The direct and indirect effects of school‐based executive function interventions on children and adolescents’ executive function, academic, social‐emotional, and behavioral outcomes: A systematic review. Campbell Systematic Reviews, 13(1), 1-63. https://doi.org/10.1002/CL2.185
63. Stucke, N. J. ve Doebel, S. (2024). Early childhood executive function predicts concurrent and later social and behavioral outcomes: A review and meta-analysis. Psychological Bulletin, 150(10), 1178–1206. https://doi.org/10.1037/bul0000445
64. Şahin, G. (2015). Okul öncesi çocukların yürütücü işlevlerinin ve duygu düzenleme becerilerinin bağlanma örüntüleri açısından incelenmesi [Yayınlanmamış doktora tezi]. Selçuk Üniversitesi.
65. Tabachnick, B. G. ve Fidell, L. S. (2001). Using multivariate statistics (4. baskı). Allyn and Bacon.
66. Theodoraki, T. E., McGeown, S. P., Rhodes, S. M. ve MacPherson, S. E. (2020). Developmental changes in executive functions during adolescence: A study of inhibition, shifting, and working memory. British Journal of Developmental Psychology, 38(1), 74–89. https://doi.org/10.1111/bjdp.12307
67. Thorell, L. B. ve Nyberg, L. (2008). The childhood executive functioning inventory (CHEXI): A new rating instrument for parents and teachers. Developmental Neuropsychology, 33(4), 536-552. https://doi.org/10.1080/87565640802101516
68. Toplak, M. E., West, R. F. ve Stanovich, K. E. (2013). Practitioner review: Do performance‐based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54(2), 131-143. https://doi.org/10.1111/jcpp.12001
69. Weiland, C., Ulvestad, K., Sachs, J. ve Yoshikawa, H. (2013). Associations between classroom quality and children’s vocabulary and executive function skills in an urban public prekindergarten program. Early Childhood Research Quarterly, 28(2), 199–209. https://doi.org/10.1016/j.ecresq.2012.12.002
70. Willoughby, M. T., Kuhn, L. J., Blair, C. B., Samek, A. ve List, J. A. (2016). The test–retest reliability of the latent construct of executive function depends on whether tasks are represented as formative or reflective indicators. Child Neuropsychology, 23(7), 822–837. https://doi.org/10.1080/09297049.2016.1205009
71. Wortham, S. C. ve Hardin, B. J. (2015). Assessment in early childhood education. Pearson Education. Zedeck, S. (Ed.). (2014). APA dictionary of statistics and research methods. American Psychological Association. https://doi.org/10.1037/14336-000
72. Zelazo, P. D. (2006). The dimensional change card sort (DCCS): A method of assessing executive function in children. Nature Protocols, 1(1), 297–301. https://doi.org/10.1038/nprot.2006.46
73. Zelazo, P. D. ve Carlson, S. M. (2012). Hot and cool executive function in childhood and adolescence: Development and plasticity. Child Development Perspectives, 6(4), 354–360. https://doi.org/10.1111/j.1750 8606.2012.00246.x
74. Zelazo, P. D. ve Müller, U. (2002). Executive function in typical and atypical development. U. Goswami (Ed.). In Blackwell handbook of childhood cognitive development (pp. 445-469). Blackwell Publishers.
75. Zelazo, P. D., Müller, U., Frye, D. ve Marcovitch, S. (2003). The development of executive function in early childhood. Monographs of The Society for Research in Child Development, 68(3), 1-137. https://doi.org/10.1111/j.0037-976x.2003.00260.x
76. Zelazo, P. D., Qu, L. ve Müller, U. (2005). Hot and cool aspects of executive function: Relations in early development. In W. Schneider, R. Schumann-Hengsteler, & B. Sodian (Eds.), Young children's cognitive development: Interrelationships among executive functioning, working memory, verbal ability, and theory of mind (pp. 71–93). Lawrence Erlbaum Associates Publishers.