Validity and reliability study of the cold executive functions test developed for specially talented students

Abstract

The aim of this study is to examine the cold executive functions of gifted students; In this context, it is to test the validity and reliability of the performance test developed to measure set shifting-inhibition, attention, working memory and planning. The study was conducted according to the survey model, one of the quantitative research methods, and was carried out with a total of 184 students, 94 girls and 90 boys, attending the 7th grade, studying at a Science and Art Center (BİLSEM) in Istanbul. The data of the research was obtained with the 'Cold Executive Functions Tests (SYIT)'. Opinions were received from a total of 19 subject experts (2 of them Information Technologies Experts), 3 for each sub-function of the test and 7 for the entire test, and relevant arrangements were made. For the criterion validity of SYİT, whose pilot studies were completed with 40 students, the students were administered the 'Wisconsin Card Sorting Test (WCST)', 'd2 Attention Test', 'n-Back Working Memory Test' and 'Istanbul 5 Cube Planning Tower Test (I5CPTT)'. Dec/Set Shifting-Inhibition Subtest and WCST scores, Dec/Attention Subtest and D2 Attentional Test scores, Dec/Working Memory Test 1 and n-Back Visual Working Memory Test scores, Dec/Planning Subtest and I5CPTT Test scores were found to have significant correlations between the scores. As a result of factor analysis; It was observed that the matched tests made evaluations sensitive to the common cognitive component. No significant relationship was found only between the SYIT/Working Memory 2 Subtest and the n-Back Auditory Working Memory Test. According to the test-retest method; Significant reliability coefficients were calculated between set shifting-keting, working memory, planning subtests and SYIT total scores. In the light of this data, it can be said that SYIT is a reliable test in all subtests except the Working Memory Subtest and a valid test in all subtests except the Working Memory 2 Subtest.

Keywords

• Attention
• Cold executive functions
• Inhibition
• Set shifting
• Special talent
• Working memory and planning

References

1. Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2005). Working memory and intelligence: The same or different constructs? Psychological Bulletin, 131(1), 30–60.
2. Alloway, T. P., & Alloway, R. G. (2010). Investigating the predictive roles of working memory and IQ in academic attainment. Journal of Experimental Child Psychology, 106(1), 20–29.
3. Alloway, T. P., & Elsworth, M. (2012). An investigation of cognitive skills and behavior in high ability students. Learning and Individual Differences, 22(6), 891–895.
4. Altun, A., & Çevik, V. (2012). Measuring working memory by using a multimedia based task. Hacettepe University Faculty of Education Journal, Special Issue, 1, 32–40.
5. Anderson, V. A., Anderson, P., Northam, E., Jacobs, R., & Catroppa, C. (2001). Development of executive functions through late childhood and adolescence in an Australian sample. Developmental Neuropsychology, 20(1), 385– 406.
6. Arffa, S. (2007). The relationship of intelligence to executive function and non-executive function measures in a sample of average, above average, and gifted youth. Archives of Clinical Neuropsychology, 22(8), 969–978.
7. Aubry, A., Gonthier, C., & Bourdin, B. (2021). Explaining the high working memory capacity of gifted children: Contributions of processing skills and executive control. Acta Psychologica, 218, 103358.
8. Baron, I. S. (2004). Neuropsychological evaluation of the child. Oxford University Press.

9. Berg, E. A. (1948). A simple objective technique for measuring flexibility in thinking. Journal of General Psychology, 39(1), 15–22.
10. Best, J. R., & Miller, P. H. (2010). A developmental perspective on executive function. Child Development, 81(6), 1641–1660.
11. Brickenkamp, R., & Zillmer, E. (1998). d2 Attention Test. Hogrefe & Huber.
12. Brody, L. E., & Mills, C. J. (1997). Gifted children with learning disabilities: A review of the issues. Journal of Learning Disabilities, 30(3), 282–296.
13. Bronson, M. B. (2000). Self-regulation in early childhood: Nature and nurture. Guilford Press.
14. Brownell, C. A., & Kopp, C. B. (2007). Transitions in toddler socioemotional development. In C. A. Brownell & C. B. Kopp (Eds.), Socioemotional development in the toddler years: Transitions and transformations (pp. 1–40). Guilford Press.
15. Chelune, G. J., & Baer, R. A. (1986). Developmental norms for the Wisconsin Card Sorting Test. Journal of Clinical and Experimental Neuropsychology, 8(3), 219–228.
16. Cinan, S. (2015). Cognitive planning and Istanbul 5 cube planning tower. Pia Publications.
17. Ciesielski, K. T., Lesnik, P. G., Savoy, R. L., Grant, E. P., & Ahlfors, S. P. (2006). Developmental neural networks in children performing a categorical n-back task. NeuroImage, 33(3), 980–990.
18. Conway, A. R., Cowan, N., Bunting, M. F., Therriault, D. J., & Minkoff, S. R. (2002). A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence, 30(2), 163–183.
19. Conway, A. R., Kane, M. J., & Engle, R. W. (2003). Working memory capacity and its relation to general intelligence. Trends in Cognitive Sciences, 7(12), 547–552.
20. Dawson, P., & Guare, R. (2010). Executive skills in children and adolescents. Guilford Press.
21. De Jong, P. F., & Das-Smaal, E. A. (1995). Attention and intelligence: The validity of the Star Counting Test. Journal of Educational Psychology, 87(1), 80–92.
22. Desco, M., Navas-Sanchez, F. J., Sanchez-González, J., Reig, S., Robles, O., Franco, C., & Arango, C. (2011).
23. Mathematically gifted adolescents use more extensive and more bilateral areas of the fronto-parietal network than controls during executive functioning and fluid reasoning tasks. NeuroImage, 57(1), 281–292.
24. Dewitte, S., & Lens, W. (2000). Procrastinators lack a broad action perspective. European Journal of Personality, 14(2), 121–140.
25. Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168.
26. Dibbets, P., Bakker, K., & Jolles, J. (2006). Functional MRI of task switching in children with specific language impairment (SLI). Neurocase, 12(1), 71–79.
27. Dikmeer, İ. A., & Gençöz, T. (2006). Examination of Wisconsin Card Sorting Test and Wechsler Intelligence Scale for Children scores of children with specific learning disability symptoms. Journal of Child and Youth Mental Health, 16(1).
28. Duan, X., Wei, S., Wang, G., & Shi, J. (2010). The relationship between executive functions and intelligence on 11- to 12-year-old children. Psychological Test and Assessment Modeling, 52(4), 419–431.
29. Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11(1), 19–23.
30. Eppinger, B., Kray, J., Mecklinger, A., & John, O. (2007). Age differences in task switching and response monitoring: Evidence from ERPs. Biological Psychology, 75(1), 52–67.
31. Eslinger, P. J. (1996). Conceptualizing, describing, and measuring components of executive function: A summary. In G. R. Lyon & N. A. Krasnegor (Eds.), Attention, memory, and executive function (pp. 367–395). Paul H. Brookes.
32. Friedman, N. P., Miyake, A., Corley, R. P., Young, S. E., DeFries, J. C., & Hewitt, J. K. (2006). Not all executive functions are related to intelligence. Psychological Science, 17(2), 172–179.
33. Friedman, N. P., & Miyake, A. (2017). Unity and diversity of executive functions: Individual differences as a window on cognitive structure. Cortex, 86, 186–204.
34. Foley Nicpon, M., Allmon, A., Sieck, B., & Stinson, R. D. (2011). Empirical investigation of twice-exceptionality: Where have we been and where are we going? Gifted Child Quarterly, 55(1), 3–17.
35. Gevins, A. S., Bressler, S. L., Cutillo, B. A., Illes, J., Miller, J. C., Stern, J., & Jex, H. R. (1990). Effects of prolonged mental work on functional brain topography. Electroencephalography and Clinical Neurophysiology, 76(4), 339–350.
36. Goodman, R., Simonoff, E., & Stevenson, J. (1995). The impact of child IQ, parent IQ and sibling IQ on child behavioural deviance scores. Journal of Child Psychology and Psychiatry, 36(3), 409–425.
37. Gotlieb, R., Hyde, E., Immordino-Yang, M. H., & Kaufman, S. B. (2016). Cultivating the social–emotional imagination in gifted education: Insights from educational neuroscience. Annals of the New York Academy of Sciences, 1377(1), 22–31.
38. Grafman, J., & Litvan, I. (1999). Importance of deficits in executive functions. The Lancet, 354(9194), 1921–1923.
39. Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of switching to new responses in a Weigl-type card sorting problem. Journal of Experimental Psychology, 38(4), 404–411.
40. Gray, J. R., Chabris, C. F., & Braver, T. S. (2003). Neural mechanisms of general fluid intelligence. Nature Neuroscience, 6(3), 316–322.
41. Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test manual: Revised and expanded. Psychological Assessment Resources.
42. Hillman, C. H., Kramer, A. F., Belopolsky, A. V., & Smith, D. P. (2006). A cross-sectional examination of age and physical activity on performance and event-related brain potentials in a task switching paradigm. International Journal of Psychophysiology, 59(1), 30–39.
43. Hofmann, W., & Van Dillen, L. (2012). Desire: The new hot spot in self-control research. Current Directions in Psychological Science, 21(5), 317–322.
44. Huizinga, M., Dolan, C. V., & Van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017–2036.
45. Jurado, M. B., & Roselli, M. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychological Review, 17(3), 213–233.
46. Karakaş, S., Irak, M., Kurt, M., & Erzengin, Ö. U. (1999). Wisconsin card sorting test and Stroop test Tbag form: Comparative analysis in terms of measured features. 3P Journal, 7(3), 179–192.
47. Karakaş, S. (2006). Bilnot Battery Handbook: Research and development studies for neuropsychological tests. Eryılmaz Ofset.
48. Kirchner, W. K. (1958). Age differences in short-term retention of rapidly changing information. Journal of Experimental Psychology, 55(4), 352–358.
49. Kornmann, J., Zettler, I., Kammerer, Y., Gerjets, P., & Trautwein, U. (2015). What characterizes children nominated as gifted by teachers? A closer consideration of working memory and intelligence. High Ability Studies, 26(1), 75–92.
50. Leana-Taşcılar, M. Z., & Cinan, S. (2014). Evaluation of executive functions and working memory of gifted and normal students and implementation of a training program tailored to their needs. Journal of Gifted Education and Research, 2(1), 1–15.
51. Mackworth, J. F. (1959). Paced memorizing in a continuous task. Journal of Experimental Psychology, 58(3), 206– 211.
52. Montoya-Arenas, D. A., Aguirre-Acevedo, D. C., Díaz Soto, C. M., & Pineda Salazar, D. A. (2018). Executive functions and high intellectual capacity in school-age: Completely overlap? International Journal of Psychological Research, 11(1), 19–32.
53. Mueller, A. (2007). Executive functioning as a cognitive characteristic of giftedness (Unpublished doctoral dissertation). St. John’s University.
54. Navarro, J. I., Ramiro, P., Lopez, J. M., Aguilar, M., Acosta, M., & Montero, J. (2006). Mental attention in gifted and nongifted children. European Journal of Psychology of Education, 21(4), 401–411.
55. Nelwan, M., Vissers, C., & Kroesbergen, E. H. (2018). Coaching positively influences the effects of working memory training on visual working memory as well as mathematical ability. Neuropsychologia, 113, 140–149.
56. Özen, Y., & Gül, A. (2007). Population-sampling issue on social and educational research studies. Journal of Kazım Karabekir Education Faculty, 15, 394–422.
57. Pascual-Leone, J. (1987). Organismic processes for neo-Piagetian theories: A dialectical causal account of cognitive development. International Journal of Psychology, 22(5–6), 531–570.
58. Pascual-Leone, J., & Baillargeon, R. (1994). Developmental measurement of mental attention. International Journal of Behavioral Development, 17(1), 161–200.
59. Passler, M. A., Isaac, W., & Hynd, G. W. (1985). Neuropsychological development of behavior attributed to frontal lobe functioning in children. Developmental Neuropsychology, 1(4), 349–370.
60. Rey-Mermet, A., Gade, M., Souza, A. S., Von Bastian, C. C., & Oberauer, K. (2019). Is executive control related to working memory capacity and fluid intelligence? Journal of Experimental Psychology: General, 148(8), 1335– 1354.
61. Roberts, R., & Gibson, E. (2002). Individual differences in sentence memory. Journal of Psycholinguistic Research, 31(6), 573–598.
62. Rodríguez Naveiras, E., Verche Borges, E., Hernández Lastiri, P., Montero López, R., & Borges del Rosal, M. Á. (2019). Differences in working memory between gifted or talented students and community samples: A meta-analysis. Psicothema, 31(3), 255–262.
63. Scherf, K. S., Sweeney, J. A., & Luna, B. (2006). Brain basis of developmental change in visuospatial working memory. Journal of Cognitive Neuroscience, 18(7), 1045–1058.
64. Swanson, H. L. (2011). Working memory, attention, and mathematical problem solving: A longitudinal study of elementary school children. Journal of Educational Psychology, 103(4), 821–834.
65. Subotnik, R. F., Olszewski-Kubilius, P., & Worrell, F. C. (2011). Rethinking giftedness and gifted education: A proposed direction forward based on psychological science. Psychological Science in the Public Interest, 12(1), 3–54.
66. Schofield, N. J., & Ashman, A. F. (1987). The cognitive processing of gifted, high average, and low average ability students. British Journal of Educational Psychology, 57(1), 9–20.
67. Sezgin, A. S. (2013). Comparison of 6–8 year old gifted and normal children in the context of age, intelligence and emotional control-will training (Master’s thesis). Istanbul Science University, Institute of Social Sciences.
68. Shelton, J. T., Metzger, R. L., & Elliott, E. M. (2007). A group-administered lag task as a measure of working memory. Behavior Research Methods, 39(3), 482–493.
69. Shelton, J. T., Elliott, E. M., Hill, B. D., Calamia, M. R., & Gouvier, W. D. (2009). A comparison of laboratory and clinical working memory tests and their prediction of fluid intelligence. Intelligence, 37(3), 283–293.
70. Silverman, L. K. (1997). Family counseling with the gifted. In N. Colangelo & G. A. Davis (Eds.), Handbook of gifted education (2nd ed., pp. 382–397). Allyn & Bacon.
71. Soland, J., Hamilton, L. S., & Stecher, B. M. (2013). Measuring 21st century competencies: Guidance for educators. Asia Society.
72. Schmidt-Atzert, L., & Bühner, M. (2000). Attention and intelligence. In K. Schweizer (Ed.), Intelligence and cognition (pp. 125–151). Verlag Empirische Pädagogik.
73. Spreen, O., & Strauss, E. (1998). A compendium of neuropsychological tests. Oxford University Press.
74. Şahin-Aközel, A., Irak, M., & Altınoğlu-Dikmeer, D. İ. (2006). Examination of executive functions in primary school children using the Wisconsin card matching test. Poster presented at the 14th National Psychology Congress, Ankara, Turkey.
75. Toker, M. (1988). d2 Standardization of attention test for secondary school students in Turkey. Psychology Studies, 18(1), 39–50.
76. Vaivre-Douret, L. (2011). Developmental and cognitive characteristics of “high-level potentialities” (highly gifted) children. International Journal of Pediatrics, 2011, 1–14.
77. Verhaeghen, P., & Basak, C. (2005). Ageing and switching of the focus of attention in working memory: Results from a modified n-back task. The Quarterly Journal of Experimental Psychology Section A, 58(1), 134–154.
78. Viana-Sáenz, L., Sastre-Riba, S., Urraca-Martínez, M. L., & Botella, J. (2020). Measurement of executive functioning and high intellectual ability in childhood: A comparative meta-analysis. Sustainability, 12(11), 4796.
79. Yaycı, L. (2013). Validity and reliability study of the d2 attention test. Kalem International Journal of Education and Human Sciences, 3(1), 43–80.
80. URL Executive functioning and gifted children. (2022, May 6). Davidson Institute for Talent Development. Retrieved March 18, 2025, from https://www.davidsongifted.org/gifted-blog/executive-functioning-and-gifted-children