Turkish Adaptation of the Test of Narrative Language for Use in Preschools

Year 2024, Volume: 6 Issue: 1, 186 - 206, 30.06.2024

Bayram Kara Ramazan Arı

https://doi.org/10.51535/tell.1469835

Abstract

The purpose of this research is to adapt the Test of Narrative Language (TNL) to Turkish culture and to test its validity-reliability for Turkish children aged 60-72 months. The research was designed in general survey model. The sample included 240 five-year-old children attending a preschool in Konya city center in the 2019-2020 academic year. The TNL developed by Gillam and Peterson in 2004 was used to measure children's narrative skills within the scope of expressive and receptive language skills. The test includes six tasks in three formats (no picture, sequence pictures, and single picture) and two subtests (comprehension and narration). Content and construct validity analyses were performed to test the validity. Internal consistency, test-retest, split-half tests, and inter-rater consistency coefficients were calculated to determine its reliability. The results showed the Turkish adaptation of the TNL is a valid and reliable instrument to measure the narrative skills of 5-year-old Turkish children.

Keywords

Narrative, language, language development, validity, reliability

Ethical Statement

2021 yılı Selçuk Üniversitesi Sağlık Bilimleri Fakültesi Klinik Olmayan Araştırmalar Etik Kurulundan Etik Kurul İzni alınmıştır. Beyan istenirse sisteme yüklenecektir.

Supporting Institution

-

Thanks

-

References

• Anastasia, A. & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice-Hall
• Başol, G. (2019). Eğitimde ölçme ve değerlendirme (6. Baskı). Ankara: Pegem Akademi Yayıncılık.
• Baykul, Y. (2021). Eğitimde ve psikolojide ölçme: klasik test teorisi ve uygulaması. (4. Baskı) Ankara. Pegem Akademi. DOI 10.14527/9786053640882
• Beaton, D., Bombardier, C., Guillemin, F. & Ferraz, M. (2001). Guidelines for the Process of Cross-Cultural Adaption of Self-Report Measures. Spine. 25. 3186-91. 10.1097/00007632-200012150- 00014.
• Berchtold, A. (2016). Test–retest: Agreement or reliability? Methodological Innovations. https://doi.org/10.1177/2059799116672875
• Boudreau, D. (2008). Narrative abilities - Advances in research and implications for clinical practice. Topics in Language Disorders, 28(2), 99-114.
• Bower, G. (1976). Experiments on story understanding and recall. Quarterly Journal of Experimental Psychology, 28,5 1 1-534
• Brown, J. D. (1996). Testing in language programs. Upper Saddle River, NJ: Prentice Hall Regents.
• Brown, T. A. (2006). Confirmatory factor analysis for applied research series. New York, USA: The Guilford Press.
• Büyüköztürk Ş. (2020). Sosyal Bilimler İçin Veri Analizi El Kitabı. İstatistik, Araştırma Deseni SPSS Uygulamaları ve Yorum (28. Baskı) Ankara: Pegem Akademi, DOI 10.14527/9789756802748
• Büyüköztürk, Ş. (2013). Sosyal bilimler için veri analizi el kitabı. Ankara: Pegem Yayıncılık.
• Child, D. (2006). The Essentials of Factor Analysis. 3rd edn. New York: Continuum.
• Cohen, R. J. & Swerdlik, M. E. (2018). Psychological testing and assessment : an introduction to tests and measurement (Ninth edition.). McGraw-Hill Education. Collins, L.M. (2007). Research Design and Methods. Encyclopedia of Gerontology (Second Edition), Pages 433-442,
• Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. doi:10.1037/0021-9010.78.1.98.
• Crocker, L. & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt. Rinehart and Winston
• Çelikli, C.B. (2020). 6-8 yaş arası çocukların dil becerilerinin öyküleme yoluyla değerlendirilmesi. Yüksek Lİsans Tezi, Ege Üniversitesi Sağlık Bilimleri Enstitüsü, İzmir. Çetin, B. (2019). Eğitimde Ölçme ve Değerlendirme (1. Baskı). Ankara: Arı Yayıncılık
• Çilingirtürk A.M. (2011). İstatistiksel Karar Almada Veri Analizi. (1. Baskı) Ankara: Seçkin Yayıncılık
• Çokluk, Ö., Şekercioğlu, G. & Büyüköztürk, Ş. (2021). Sosyal Bilimler İçin Çok Değişkenli İstatistik: SPSS ve Lisrel Uygulamaları. (6. Baskı) Ankara: Pegem Akademi Yayıncılık.
• Dale, P. & Henderson, V. (1987). An Evaluation of the Test of Early Language Development as a Measure of Receptive and Expressive Language. Language Speech and Hearing Services in Schools. 18. 179. 10.1044/0161-1461.1802.179.
• Davies, A. (2007). Storytelling in the classroom, enhancing traditional oral skills for teachers and pupils. SAGE Publications (Paul Chapman Publishing): London, UK
• Demir, S. (2017). Ölçmede Geçerlik. (Editör: R. N. Demirtaşlı). Eğitimde Ölçme ve Değerlendirme (4. Baskı). Ankara: Anı Yayıncılık (s. 57-76)
• Demircioğlu, G. (2015). Geçerlilik ve Güvenilirlik (Editör: Emin Karip) Ölçme ve Değerlendirme (7. Baskı) Ankara: Pegem Akademi Yayıncılık (s. 89-122)
• Duinmeijer, I., de Jong, J. & Scheper, A. (2012). Narrative abilities, memory, and attention in children with a specific language impairment. International Journal of Language and Communication Disorders, 47(5), 542-55
• Eriksson, M. (2006). Sex differences in language development as a topic for cross-culturalcomparisons. Proceedings from the First European Network Meeting on the Communica-tive Development Inventories,103–114.
• Erkuş, A. (2003). Psikometri üzerine yazılar. Ankara: Türk Psikologlar Derneği Yayınları. No 24.
• Erkuş, A. (2019). Psikolojide Ölçme ve Ölçek Geliştirme I: Temel Kavramlar ve İşlemler (4. Baskı). Ankara: Pegem Yayınları
• Frederic, M. L. (1956). Sampling Error due to Choice of Split in Split-Half Reliability Coefficients, The Journal of Experimental Education, 24:3, 245-249, DOI: 10.1080/00220973.1956.11010545
• Frey, B. (2018). The SAGE encyclopedia of educational research, measurement, and evaluation (Vols. 1-4). Thousand Oaks,, CA: SAGE Publications, Inc. doi: 10.4135/9781506326139 Retrieved 15.06.2021 from https://methods.sagepub.com/reference/the-sage-encyclopedia-of-educational-research-measurement-and-evaluation/i19572.xml.
• Frost, M. H., Reeve, B. B., Liepa, A. M., Stauffer, J. W., Hays, R. D., & Mayo/FDA Patient-Reported Outcomes Consensus Meeting Group (2007). What is sufficient evidence for the reliability and validity of patient-reported outcome measures?. Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research, 10 Suppl 2, S94–S105. https://doi.org/10.1111/j.1524-4733.2007.00272.x
• Gamble, N. & Yates, S. (2008), Exploring Children’s Literature, London: Sage
• Gambrell, L. B. & Dromsky, A. (2000). Fostering reading comprehension. In D. S. Strickland & L. M. Morrow (Eds.), Beginning reading and writing (pp. 143-153). New York, NY: Teachers College Press. Gillam, R. B. & Pearson, N. (2004). Test of Narrative Language. Austin, TX: PRO-ED
• Golden, J. (1984). Children's concept of story in reading and writing. Reading Teacher, 37, 578-584.
• Güler, T. & Baykoç Dönmez, N. (2007). “48-72 Aylar Arasındaki Türk Çocuklarının Alıcı Dil Yapılarının İncelenmesi”, Eğitim Araştırmaları Dergisi, 7 (27), 83-96.
• Hair, J., Black, W., Babin, B. & Anderson, R. (2010). Multivariate data analysis (7th ed.). Upper Saddle River, Prentice-Hall, NJ, USA.
• Hambleton, R. K. (2017). Testlerin Birden Çok Dil ve Kültüre Uyarlanmasıyla İlgili Konular, Uyaralama Desenleri ve Uyarlama İçin Teknik Yönergeler (Ed. Ronald K. Hableton, Peter F. Merenda, Charles D. Spielberg), İçinde, Eğitimde Ve Psikolojide Kullanılan Testlerin Kültürlerarası Değerlendirme Amacıyla Uyarlanması (s. 1-40).
• Heilmann, J., Miller, J. F., & Nockerts, A. (2010). Sensitivity of narrative organization measures using narrative retells produced by young school age children. Language Testing, 27(4), 603- 626
• Hinkin, T. R. (1998). A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106
• Hopkins, W. G. (2000). A scale of magnitudes for effect statistics. Retrieved 28.06.2021 from http://www.sportsci.org /resource/stats/effectmag.html
• Hudson, J.A., & Shapiro, L.R. (1991). From knowing to retelling: The development of children’s scripts, stories, and personal narratives. In McCabe, A. & Peterson, C. (Eds.), Developing Narrative Structure. Lawrence Erlbaum Associates, Inc. Hillsdale
• Hulin, C. & Netemeyer, R. & Cudeck, R. (2001). Can a Reliability Coefficient Be Too High? Journal of Consumer Psychology. 10. 55-58. 10.2307/1480474.
• Justice, L. M., Bowles, R., Kaderavek, J., Ukrainetz, T., Eisenberg, S.,& Gillam, R. (2006). The Index of Narrative Microstructure: A clinical tool for analyzing school-age children’s narrative performances. American Journal of Speech-Language Pathology / American Speech-Language-Hearing Association,15, 177-91. 10.1044/1058-0360(2006/017).
• Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575
• Kalfoss, M. (2019). Translation and Adaption of Questionnaires: A Nursing Challenge. SAGE Open Nursing. 5. 237796081881681. 10.1177/2377960818816810.
• Kan, A. (2019). Ölçme Araçlarında Bulunması Gereken Nitelikler. (Editör: H. Atılgan). Eğitimde Ölçme ve Değerlendirme (12. Baskı) Ankara: Anı Yayıncılık (s. 43-102)
• Kanmaz, S. (2019). Okul öncesi dönemdeki çocukların öyküleme yoluyla dil becerilerinin değerlendirilmesi. Yüksek Lİsans Tezi, Ege Üniversitesi Sağlık Bilimleri Enstitüsü, İzmir.
• Kapuscinski, A. N. & Masters, K. S. (2010). The current status of measures of spirituality: a critical review of scale development. Psychology of Religion and Spirituality, 2(4), 191–205. http://dx.doi.org/10.1037/a0020498.
• Karabaş, Ö. (2002). Okul öncesi dönemindeki Türk çocuklarının hikâye öyküleme becerisinin gelişimi. Yüksek Lisans Tezi, Orta Doğu Teknik Üniversitesi / Sosyal Bilimler Enstitüsü, Ankara.
• Karasar, N. (2009). Bilimsel araştırma yöntemi: kavramlar, ilkeler, teknikler. Nobel Yayın Karasar, N. (2013). Bilimsel araştırma yöntemi. Ankara: Nobel Yayın Dağıtım.
• Khan, K., Gugiu, M., Justice, L., Bowles, R., Skibbe, L. & Piasta, S. (2016). Age-Related Progressions in Story Structure in Young Children's Narratives. Journal of Speech Language and Hearing Research. 59. 1. 10.1044/2016_JSLHR-L-15-0275.
• Kline, P. (2000) The handbook of psychologial testing. London: Taylor & Francis Group
• Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd ed.). New York: Guilford Press.
• Kosaka, M. (2016). Narrative Development of Contents and Structures in Story Telling. The Japan Journal of Logopedics and Phoniatrics. 57. 261-271. 10.5112/jjlp.57.261.
• Kottner, J., Audigé, L., Brorson, S., Donner, A., Gajewski, B. J., Hróbjartsson, A., Roberts, C., Shoukri, M., & Streiner, D. L. (2011). Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. Journal of clinical epidemiology, 64(1), 96–106. Retrieved 16.06.2021 from https://doi.org/10.1016/j.jclinepi.2010.03.002
• Leahy, M. J., Szymanski, E. M. & Linkowski, D. C. (1993). Knowledge importance in rehabilitation counseling. Rehabilitation Counselling Bulletin, 37, 130-145.
• Mages, W. K. (2008). Language and theory of mind development in the context of a Head Start Theatre-in-Education program. PhD dissertation., Harvard University.
• Mandler, J. M. & Johnson, N. S. (1977). Remembrance of things parsed: Story structure and recall. Cognitive Psychology, vol. 9 (January 1977), pp. 111-151.
• Martin, R. A. & Ford T.E. (2018). The Personality Psychology of Humor, (Editors: Rod A. Martin, Thomas E. Ford). The Psychology of Humor (p. 99-140) Academic Press, (Second Edition) ISBN 9780128121436, https://doi.org/10.1016/B978-0-12-812143-6.00004-7.(https://www.sciencedirect.com/science/aticle/pii/B9780128121436000047)
• McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia medica, 22(3), 276–282.
• McIntyre, L. J. (2005). Investigating teachers ‘knowledge of oral language, Doctoral Dissertation. University of Alberta, Canada.
• MEB (2013). Milli Eğitim Bakanlığı okul öncesi eğitim programı. http://docplayer.biz.tr/895440-T-c-milli-egitim-bakanligi-talim-ve-terbiye-kurulu-baskanligi-konu-okul-oncesi-egitim-programı.html.
• Meier, A. (2020). Early growth trajectories of narrative language development: Sex differences in microstructural and macrostructural skills (Order No. 27958836). Available from ProQuest Dissertations & Theses Global. (2399400084). Retrieved 25.04.2021 from https://search.proquest.com/dissertations-theses/early-growth-trajectories-narrative- language/docview/2399400084/se-2?accountid=16935
• Merenda, P. F. (2017). Eğitimde ve Psikolojide Kullanılan Testlerin Kültürlerarası Uyarlanması (Ed. Ronald K. Hableton, Peter F. Merenda, Charles D. Spielberg), İçinde, Eğitimde Ve Psikolojide Kullanılan Testlerin Kültürlerarası Değerlendirme Amacıyla Uyarlanması (s. 329-350). Nizamettin Koç ve Ahmet Yıldırım (Çev.) Ankara: Pegem Akademi Yayıncılık
• Merritt, D.D. & Liles B.Z. (1987). Story grammar ability in children with and without language disorder: Story generation, story retelling, and story comprehension. Journal of Speech and Hearing Research, 30, 539–552.
• Milburn, T.F., Girolametto, L., Weitzmam, E. & Greenberg, J. (2014) Enhancing preschool educators’ ability to facilitate conversations during shared book reading. Journal of Early Childhood Literacy 14: 105–40.
• Mills, M. T. (2015). The Effects of Visual Stimuli on the Spoken Narrative Performance of School-Age African American Children. Language, speech, and hearing services in schools, 46(4), 337–351. https://doi.org/10.1044/2015_LSHSS-14-0070
• Morrow, L. (1985). Retelling stories: A strategy for improving young children’s comprehension, concept of story structure, and oral language complexity. The Elementary School Journal, 85, 647-661.
• Morrow, L. M. (1986}. Effects of structural guidance in story retelling on children's dictation of original stories. Journal of Reading Behavior, 18, (2), 135-152.
• Morrow, L. M. (1990). Assessing children’s understanding of story through their construction and reconstruction of narrative. In L. M. Morrow & J. K. Smith (Eds.), Assessment for instruction in early literacy (pp. 110–134). Englewood Cliffs, NJ: Prentice-Hall
• Öner, N. (1997). Türkiye’de kullanılan psikolojik testler: Bir başvuru kaynağı (3.baskı). İstanbul: Boğaziçi Üniversitesi Yayınları
• Özgüven, İ.E. (2011). Psikolojik testler. Ankara: Pdrem Yayınları.
• Petersen, D. B., Gillam, S. L., Spencer, T., & Gillam, R. B. (2010). The effects of literate narrative intervention on children with neurologically based language impairments: An early stage study. Journal of Speech, Language, and Hearing Research, 53, 961-981.
• Peterson, C. (1990). The who, when, and where of early narratives. Journal of Child Language, 17, 433-455.
• Peterson, R. (1994). A Meta-Analysis of Cronbach's Coefficient Alpha. Journal of Consumer Research. 21. 381-91. 10.1086/209405.
• Richert, R., Sachet, A., Hoffman, R. & Taylor, M. (2009). Learning From Fantasy and Real Characters in Preschool and Kindergarten. Journal of Cognition and Development. 10. 41-66. 10.1080/15248370902966594.
• Ryder, N. & Leinonen, E. (2003). Use of Context in Question Answering by 3-, 4- and 5-Year-Old Children. Journal of psycholinguistic research. 32. 397-415. 10.1023/A:1024847529077.
• Saad, S., Carter, G., Rothenberg, M., & Israelson, E. (1999). Testing and Assessment: An Employer's Guide to Good Practices. Seçer, İ. (2015). Psikolojik Test Geliştirme ve Uygulama Süreci. (1. Baskı). Anı Yayıncılık: Akara.
• Şencan, H. (2005). Sosyal ve davranissal ölçümlerde güvenilirlik ve geçerlilik. (1. Baskı). Ankara: Seçkin Yayınevi.
• Snaith, M. (2007). Children’s Care Learning and Development, London: Heinemann Stadler, M. & Ward, G. (2005). Supporting the Narrative Development of Young Children. Early Childhood Education Journal. 33. 73-80. 10.1007/s10643-005-0024-4.
• Şimşek, Ö. F. (2007). Yapısal eşitlik modellemesine giriş: Temel ilkeler ve LISREL uygulamaları. Ankara: Ekinoks.
• Tatlıdil, H. (2002). Uygulamalı çok değişkenli istatistiksel analiz. Ankara: Akademi Matbaası Tavakol, M. & Dennick, R. (2011). Making Sense of Cronbach's Alpha. International Journal of Medical Education. 2. 53-55. 10.5116/ijme.4dfb.8dfd.
• Tavşancıl, E. (2019). Tutumların Ölçülmesi ve SPSS ile Veri Analizi (6.Baskı) Ankara: Nobel Akademik Yayıncılık.
• Thompson, B. L., Green, S. B., & Yang, Y. (2010). Assessment of the Maximal Split-Half Coefficient to Estimate Reliability. Educational and Psychological Measurement, 70(2), 232–251. https://doi.org/10.1177/0013164409355688 Tyupa, S. (2011). A theoretical framework for back-translation as a quality assessment tool. 7. 35-46.
• Uzunboylu, H., & Ozdamlı, F. (2011). Teacher perception for m-learning: scale development and teachers’ perceptions. Journal of Computer Assisted Learning, 27, 544–556. http://dx.doi.org/10.1111/j.1365-2729.2011.00415.x.
• van Kraayenoord, C. E., & Paris, S. G. (1996). Story construction from a picture book: An assessment activity for young learners. Early Childhood Research Quarterly, 11(1), 41–61
• Walker, C. M., Ganea, P. A. & Gopnik, A. (2012). Children's Causal Learning from Fiction: Assessing the Proximity Between Real and Fictional Worlds. Proceedings of the Annual Meeting of the Cognitive Science Society, 34. Retrieved 26.04.2021 from https://escholarship.org/uc/item/3dk4b2tr
• Weisberg, D., Ilgaz, H., Hirsh-Pasek, K., Golinkoff, R., Nicolopoulou, A. & Dickinson, D. (2015). Shovels and swords: How realistic and fantastical themes affect children's word learning. Cognitive Development. 35. 10.1016/j.cogdev.2014.11.001.
• Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee‐Lorenz, A. & Erikson, P. (2005), Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient‐ Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value in Health, 8: 94-104. https://doi.org/10.1111/j.1524-4733.2005.