Development and psychometric evaluation of the School Adjustment Scale for Turkish middle school students

Abstract

This study aimed to develop and conduct a comprehensive psychometric evaluation of a scale designed to measure middle school students' school adjustment levels (School Adjustment Scale for Middle School Students - SASMSS). The item pool created as a result of a literature review conducted by researchers was subjected to expert evaluation for content validity, involving a panel of specialists in educational sciences and psychology. The research was carried out using a methodological research design. Data were collected from three independent convenience samples: Sample 1 (n = 1242) for exploratory factor analysis (EFA), Sample 2 (n = 1222) for confirmatory factor analysis (CFA), and Sample 3 (n = 1326) for CFA replication and measurement invariance analysis. The EFA results revealed a three-factor structure, comprising academic, social, and behavioral adjustment domains, with six sub-dimensions (academic interest, academic competence, externalization behavior, adherence to rules, prosocial behaviors, and friendship relations), explaining 42.93% of the total variance. The hypothesized structure was supported by CFA with excellent fit indices (CFI = .93, TLI = .92, RMSEA = .04, SRMR = .04). Measurement invariance analysis across gender further demonstrated that the scale exhibits equivalent psychometric properties for male and female respondents. Additionally, Differential Item Functioning (DIF) analysis based on ordinal logistic regression revealed no significant gender-related item bias, reinforcing item-level fairness. These findings provide strong evidence for the validity, reliability, and fairness of the SASMSS scale within the Turkish educational context.

Keywords

• Adjustment to middle school
• Scale development
• Middle school students
• Exploratory factor analysis
• Confirmatory factor analysis

References

1. Adelson, J.L., & McCoach, D.B. (2010). Measuring the mathematical attitudes of elementary students: The effects of a 4-point or 5-point Likert-type scale. Educational and Psychological Measurement, 70(5), 796-807. https://doi.org/10.1177/0013164410366694
2. Adeyemo, D. (2005). The buffering effect of emotional intelligence on the adjustment of secondary school students in transition. Electronic Journal of Research in Educational Psychology, 3(6), 79-90.
3. American Psychological Association. (n.d.). Social adjustment. In APA dictionary of psychology. Retrieved March 20, 2024, from https://dictionary.apa.org/social-adjustment
4. Anderson, J.R., Guan, Y., & Koc, Y. (2016). The academic adjustment scale: Measuring the adjustment of permanent resident or sojourner students. International Journal of Intercultural Relations, 54, 68-76. https://doi.org/10.1016/j.ijintrel.2016.07.006
5. Anderson, L.W., Jacobs, J., Schramm, S., & Splittgerber, F. (2000). School transitions: Beginning of the end or a new beginning? International Journal of Educational Research, 33(4), 325-339. https://doi.org/10.1016/S0883-0355(00)00020-3
6. Baker, R.W., & Siryk, B. (1984). Measuring adjustment to college. Journal of Counseling Psychology, 31(2), 179-189. https://psycnet.apa.org/doi/10.1037/0022-0167.31.2.179
7. Baker, R.W., & Siryk, B. (1999). SACQ: Student adaptation to college questionnaire: Manual. Western Psychological Services.
8. Bandura, A. (1997). Self-efficacy: The exercise of control. W H Freeman/Times Books/ Henry Holt & Co.

9. Beavers, A.A., Lounsbury, J.W., Richards, J.K., Huck, S.W., Skolits, G.J., & Esquivel, S.L. (2013). Practical considerations for using exploratory factor analysis in educational research. Practical Assessment, Research, and Evaluation, 18(1), Article 6. https://doi.org/10.7275/qv2q-rk76
10. Berlin, L.J., Dunning, R.D., & Dodge, K.A. (2011). Enhancing the transition to kindergarten: A randomized trial to test the efficacy of the “Stars” summer kindergarten orientation program. Early Childhood Research Quarterly, 26(2), 247-254. https://doi.org/10.1016/j.ecresq.2010.07.004
11. Birch, S.H., & Ladd, G.W. (1997). The teacher-child relationship and children's early school adjustment. Journal of School Psychology, 35(1), 61 79. https://doi.org/10.1016/S0022 4405(96)00029-5
12. Brass, N., McKellar, S.E., North, E.A., & Ryan, A.M. (2019). Early adolescents’ adjustment at school: A fresh look at grade and gender differences. The Journal of Early Adolescence, 39(5), 689-716. https://doi.org/10.1177/0272431618791291
13. Brown, T.A. (2006). Confirmatory factor analysis for applied researchers. Guilford Publications.
14. Büyüköztürk, Ş. (2002). Faktör analizi: Temel kavramlar ve ölçek geliştirmede kullanımı [Factor analysis: Basic concepts and its use in scale development]. Kuram ve Uygulamada Eğitim Yönetimi, 32(32), 470-483.
15. Cadima, J., Leal, T., & Burchinal, M. (2010). The quality of teacher-student interactions: Associations with first graders' academic and behavioral outcomes. Journal of School Psychology, 48(6), 457-482. https://doi.org/10.1016/j.jsp.2010.09.001
16. Chang, T.F., & Qin, D.B. (2017). Relations between academic adjustment and parental psychological control of academically gifted Chinese American and European American students. Child Indicators Research, 10(3), 715-734. https://doi.org/10.1007/s12187-016-9403-1
17. Chen, S., & Xu, C. (2024). Predictive Mean Matching Imputation Procedure Based on Machine Learning Models for Complex Survey Data. Journal of Data Science, 22(3), 456 468. https://doi.org/10.6339/24-JDS1135
18. Cheung, G.W., & Rensvold, R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233 255. https://doi.org/10.1207/S15328007SEM0902_5
19. Comrey, A.L., & Lee, H.B. (1992). A first course in factor analysis (2nd ed.). Lawrence Erlbaum Associates, Inc.
20. Craighead, W.E., & Nemeroff, C.B. (2001). The Corsini encyclopedia of psychology and behavioral science. Wiley.
21. Çivril-Kara, R., Küçük-Kılıç, S., & Öncü, E. (2017). Sınıf öğretmenlerinin oyun ve fiziki etkinlikler dersi hakkındaki görüşleri [Classroom teachers' opinions on the play and physical activities lesson]. Eğitim ve İnsani Bilimler Dergisi: Teori ve Uygulama, 8(15), 18-46.
22. Demirtas-Zorbaz, S. (2016). İlkokul birinci sınıf öğrencilerinin okula uyumu: Bir model testi [School adjustment in first grades of primary school: Testing a model.] [Unpublished doctoral dissertation]. Hacettepe Üniversitesi.
23. DeVellis, R.F. (2017). Scale development: Theory and applications (4th ed.). Sage.
24. Eccles, J.S., & Roeser, R.W. (2011). Schools as developmental contexts during adolescence. Journal of Research on Adolescence, 21(1), 225-241. https://doi.org/10.1111/j.1532-7795.2010.00725.x
25. Eisenberg, N., Fabes, R.A., & Spinrad, T.L. (2006). Prosocial Development. In N. Eisenberg, W. Damon, & R.M. Lerner (Eds.), Handbook of child psychology: Social, emotional, and personality development (6th ed., pp. 646-718). John Wiley & Sons, Inc.
26. Elliott, D.C. (2016). The impact of self-beliefs on post-secondary transitions: The moderating effects of institutional selectivity. Higher Education, 71, 415-431. https://doi.org/10.1007/s10734-015-9913-7
27. Erath, S.A., Flanagan, K.S., & Bierman, K.L. (2008). Early adolescent school adjustment: Associations with friendship and peer victimization. Social development, 17(4), 853-870.
28. Erduran, B., & Öztürk, S. (2016). The relationship between social support and social adjustment in adolescents. Journal of Education and Training Studies, 4(7), 85-92.
29. Erten Sarıkaya, H. (2012). Okul öncesi eğitime devam eden 5-6 yaş çocuklarının sosyal beceri, akran ilişkileri ve okula uyum düzeyleri arasındaki ilişkilerin izlenmesi [Following relations of 5-6 year-old children, who attend preschool education, in terms of social skills, peer relationships and school adjustment levels] [Unpublished master’s thesis]. Pamukkale Üniversitesi.
30. Feldman, M.A., Ojanen, T., Gesten, E.L., Smith‐Schrandt, H., Brannick, M., Totura, C.M.W., & Brown, K. (2014). The effects of middle school bullying and victimization on adjustment through high school: Growth modeling of achievement, school attendance, and disciplinary trajectories. Psychology in the Schools, 51(10), 1046-1062.
31. Fredricks, J.A., Blumenfeld, P.C., & Paris, A.H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59 109. https://doi.org/10.3102/00346543074001059
32. Fornell, C., & Larcker, D.F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39 50. https://doi.org/10.2307/3151312
33. Fraenkel, J.R., Wallen, N.E., & Hyun, H.H. (2012). How to design and evaluate research in education (8th ed.). McGraw-Hill.
34. Gençtanırım-Kurt, D. (2022). Effect of family, friends, and school climate on school adjustment of middle school students. International Journal of Progressive Education, 18(2), 193-209.
35. George, D., & Mallery, P. (2001). SPSS for Windows step by step: A simple guide and reference. Allyn & Bacon.
36. Gorsuch, R.L. (1983). Factor analysis (2nd ed.). Erlbaum.
37. Hair, J.F., Jr., Sarstedt, M., Hopkins, L., & Kuppelwieser, V.G. (2014). Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research. European Business Review, 26(2), 106-121. https://doi.org/10.1108/EBR-10-2013-0128
38. Harrington, D. (2009). Confirmatory factor analysis. Oxford University Press.
39. Horn, J.L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179-185. https://doi.org/10.1007/BF02289447
40. Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
41. Huang C.Y., Hunt, E., & Stormshak E.A. (2023). Differential impact of the school context on ethnic and racial identity and depression for monoracial and multiracial early adolescents. Frontiers in Psychiatry, 14, Article 1080085. https://doi.org/10.3389/fpsyt.2023.1080085
42. Izaguirre, L.A., Rodríguez-Fernández, A., & Fernández-Zabala, A. (2023). Perceived academic performance is explained by school climate, positive psychological variables, and life satisfaction. British Journal of Educational Psychology, 93(1), 318-332. https://doi.org/10.1111/bjep.12557
43. Jessor, R. (Ed.). (1998). New perspectives on adolescent risk behavior. Cambridge University Press.
44. Juvonen, J., & Wentzel, K.R. (Eds.). (1996). Social motivation: Understanding children's school adjustment. Cambridge University Press.
45. Kaya, Ö.S., & Akgün, E. (2016). Okul öncesi dönemdeki çocukların okula uyum düzeylerinin çeşitli değişkenler açısından incelenmesi [Investigation of preschool children's school adjustment levels in terms of various variables]. Elementary Education Online, 15(4), 1311 1324. https://doi.org/10.17051/io.2016.51992
46. Kaynak, S., & Kan, A. (2024). School adjustment scale for high school students: Development and initial validation. Psychology in the Schools, 61, 4063-4079. https://doi.org/10.1002/pits.23269
47. Kaynak, S., & Uslu, O. (2024). Ortaokul Öğrencileri İçin Okula Uyum Ölçeği: Bir ölçek geliştirme çalışması [School Adjustment Scale for Middle School Students: A scale development study]. Türkiye Sosyal Araştırmalar Dergisi, 28(1), 173-190. https://doi.org/10.20296/tsadergisi.1340077
48. Kline, R.B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
49. Ladd, G.W. (1989). Children's social competence and social supports: Precursors of early school adjustment? In B.H. Schneider, G. Attili, J. Nadel, & R.P. Weissberg (Eds.), Social competence in developmental perspective (pp. 277-291). Kluwer Academic/Plenum Publishers.
50. Lakhani, P.K., Jain, K., & Chandel, P.K. (2017). School adjustment, motivation, and academic achievement among students. International Journal of Research in Social Sciences, 7(10), 333-348.
51. Lawshe, C.H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
52. MacCallum, R.C., Widaman, K.F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84-99. https://doi.org/10.1037/1082-989X.4.1.84
53. Mequald, E.L., Kopel, S.J., & Nassan, J.H. (2001). Behaviour adjustment in children with asthma: A meta analysis. Journal of Developmental and Behavioural Paediatrics, 22(6), 430 439. https://doi.org/10.1097/00004703-200112000-00011
54. Mertler, C.A., & Vannatta, R.A. (2005). Advanced and multivariate statistical methods: Practical application and interpretation (3rd ed.). Pyrczak Publishing.
55. Ministry of National Education [MoNE]. (2015). Millî Eğitim Bakanlığı 2015-2019 Stratejik Planı [Ministry of National Education 2015-2019 Strategic Plan].
56. Muthén, L.K., & Muthén, B.O. (2017). Mplus: Statistical analysis with latent variables: User’s guide (Version 8). Muthén & Muthén.
57. Nansel, T.R., Haynie, D.L., & Simons-Morton, B.G. (2003). The association of bullying and victimization with middle school adjustment. In M.J. Elias & J.E. Zins (Eds.), Bullying, peer harassment, and victimization in the schools: The next generation of prevention (pp. 45-61). Haworth Press.
58. Nunnally, J.C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.
59. Nunnally, J.C., & Bernstein, I.H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
60. O’Connor, B.P. (2023). EFA.dimensions: Exploratory factor analysis functions for assessing dimensionality (Version 0.1.8.4) [R package]. CRAN. https://doi.org/10.32614/CRAN.package.EFA.dimensions
61. R Core Team (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
62. Ratelle, C.F., Duchesne, S., & Guay, F. (2017). Predicting school adjustment from multiple perspectives on parental behaviors. Journal of Adolescence, 54, 60 72. https://doi.org/10.1016/j.adolescence.2016.11.008
63. Reich, H.A., & Flanagan, K.S. (2010). School adjustment. In I.B. Weiner & W.E. Craighead (Eds.), The Corsini encyclopedia of psychology (Vol. 1, pp. 1513 1514). Wiley. https://doi.org/10.1002/9780470479216.corpsy0824
64. Revelle, W. (2023). Psych: Procedures for psychological, psychometric, and personality research [R package]. https://cran.r-project.org/web/packages/psych/index.html
65. Rienties, B., Beausaert, S., Grohnert, T., Niemantsverdriet, S., & Kommers, P. (2012). Understanding academic performance of international students: The role of ethnicity, academic and social integration. Higher Education, 63(6), 685-700. https://doi.org/10.1007/s10734-011-9468-1
66. Robitzsch, A. (2022). Sirt: Supplementary item response theory models (Version 3.12-66) [R package]. https://cran.r-project.org/package=sirt
67. Rodríguez-Fernández, A., Droguett, L., & Revuelta, L. (2012). School and personal adjustment in adolescence: The role of academic self-concept and perceived social support. Revista de Psicodidáctica, 17(2), 397-414.
68. Rosseel Y (2012). “lavaan: An R package for structural equation modeling.” Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02.
69. Ryan, A.M., & Ladd, G.W. (Eds.). (2012). Peer relationships and adjustment at school. IAP.
70. Sauerwein, M. N., & Rees, G. (2020). How children spend their out-of-school time: A comparative view across 14 countries. Children and Youth Services Review, 112, Article 104939. https://doi.org/10.1016/j.childyouth.2020.104939
71. Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8(2), 23-74.
72. Simsek, H., Kurt, D.G., & Kula, S.S. (2020). A school-based adjustment program based on an ecological approach for immigrant students in primary schools living in Türkiye. Elementary Education Online, 19(4), 2552-2563. https://ilkogretim-online.org/index.php/pub/article/view/6635
73. Spencer, M.B. (1999). Social and cultural influences on school adjustment: The application of an identity focused approach. Educational Psychologist, 34(1), 43 57. https://doi.org/10.1207/s15326985ep3401_4
74. Stefana, A., Langfus, J.A., Palumbo, G., Cena, L., Trainini, A., Gigantesco, A., & Mirabella, F. (2023). Comparing the factor structures and reliabilities of the EPDS and the PHQ-9 for screening antepartum and postpartum depression: A multigroup confirmatory factor analysis. Archives of Women's Mental Health, 26(5), 659-668. https://doi.org/10.1007/s00737-023-01337-w
75. Şener, G. (2018). Türkiye’de yaşanan eğitim sorunlarına güncel bir bakış [A current overview of education problems in Türkiye]. Millî Eğitim Dergisi, 47(218), 187-200.
76. Tabachnick, B.G., & Fidell, L.S. (2019). Using multivariate statistics (7th ed.). Pearson Education.
77. Taylor, C.A., Liang, B., Tracy, A.J., Williams, L.M., & Seigle, P. (2002). Gender differences in middle school adjustment, physical fighting, and social skills: Evaluation of a social competency program. Journal of Primary Prevention, 23(2), 259 272. https://doi.org/10.1023/A:1019976617776
78. Taylor, R.D., Oberle, E., Durlak, J.A., & Weissberg, R.P. (2017). Promoting positive youth development through school‐based social and emotional learning interventions: A meta‐analysis of follow‐up effects. Child Development, 88(4), 1156-1171. https://doi.org/10.1111/cdev.12864
79. Tomás, J.M., Gutiérrez, M., Pastor, A.M., & Sancho, P. (2020). Perceived social support, school adaptation, and adolescents’ subjective well being. Child Indicators Research, 13, 1597 1617. https://doi.org/10.1007/s12187-020-09717-9
80. Türkiye Anne, Çocuk ve Ergen Sağlığı Enstitüsü (TÜSEB). (2019). Türk eğitim sistemi, eğitim yaş aralıkları ve zorunlu eğitimin tarihsel gelişimi [Turkish education system, educational age ranges and historical development of compulsory education].
81. Ueno, K., & McWilliams, S. (2010). Gender-typed behaviors and school adjustment. Sex Roles, 63(7-8), 580-591. https://doi.org/10.1007/s11199-010-9839-6
82. Valka, S. (2015). Management of international students’ academic adjustment: Challenges and solutions. European Scientific Journal, 11, 161 168. http://eujournal.org/index.php/esj/article/view/5219
83. Valois, R.F., MacDonald, J.M., Bretous, L., Fischer, M.A., & Drane, J.W. (2002). Risk factors and behaviors associated with adolescent violence and aggression. American Journal of Health Behavior, 26, 454-464. http://dx.doi.org/10.5993/AJHB.26.6.6
84. Van Buuren, S., & Groothuis-Oudshoorn, K. (2011). Mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1-67. https://doi.org/10.18637/jss.v045.i03
85. Van Rossem, R., Vermande, M., Völker, B. & Baerveldt, C. (2015). Social capital in the classroom: A study of in-class social capital and school adjustment. British Journal of Sociology of Education, 36(5), 669-688. http://dx.doi.org/10.1080/01425692.2013.848779
86. Van Rooij, E.C.M., Jansen, E.P.W.A., & van de Grift, W.J.C.M. (2017). First-year university students’ academic success: The importance of academic adjustment. European Journal of Psychology of Education, 33, 749-767. https://doi.org/10.1007/s10212-017-0347-8
87. Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-69. https://doi.org/10.1177/109442810031002
88. Wang, M.T., & Degol, J. (2014). Staying engaged: Knowledge and research needs in student engagement. Child development perspectives, 8(3), 137-143. https://doi.org/10.1111/cdep.12073
89. Wentzel, K.R. (1991). Relations between social competence and academic achievement in early adolescence. Child Development, 62(5), 1066 1078. https://doi.org/10.1111/j.1467 8624.1991.tb01589.x
90. Wentzel, K.R. (1993). Motivation and achievement in early adolescence: The role of multiple classroom goals. The Journal of Early Adolescence, 13(1), 4 20. https://doi.org/10.1177/0272431693013001001
91. Wentzel, K.R. (2003). Sociometric status and adjustment in middle school: A longitudinal study. The Journal of Early Adolescence, 23(1), 5-28. https://doi.org/10.1177/0272431602239128
92. West, S.G., Finch, J.F., & Curran, P.J. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R.H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 56-75). Sage.
93. Wigfield, A., & Eccles, J.S. (2000). Expectancy-value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68-81. https://doi.org/10.1006/ceps.1999.1015
94. Yılmaz, O., & Avcı, D. (2022). Okul uyumu ölçeğinin geliştirilmesi [Development of School Adjustment Scale]. Okul Psikolojik Danışmanlığı Dergisi, 5(1), 41-72.