int. j. assess. tools educ. International Journal of Assessment Tools in Education 2148-7456 İzzet KARA Scale Development Ölçek Geliştirme The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School https://orcid.org/0000-0003-0291-4247 Ceylan Mehmet KIRIKKALE UNIVERSITY, FACULTY OF SPORT SCIENCES, DEPARTMENT OF PHYSICAL EDUCATION AND SPORT TEACHING https://orcid.org/0009-0004-5674-8189 Ceylan Kevser KIRIKKALE UNIVERSITY, FACULTY OF SPORTS SCIENCE https://orcid.org/0000-0003-2289-1257 Yoncalık Oguzhan KIRIKKALE UNIVERSITY, FACULTY OF SPORTS SCIENCE Advanced Online Publication 06 30 2025 02 03 2026 Copyright © 2014, International Journal of Assessment Tools in Education 2014 International Journal of Assessment Tools in Education

Achievement emotions such as enjoyment, anxiety, and boredom significantly influence students’ motivation, engagement, and performance in physical education (PE). Despite growing interest in academic emotions, age-appropriate tools for younger students remain limited. This study aimed to adapt and validate a brief, visually supported scale to assess enjoyment, anxiety, and boredom in PE. The goal was to develop a developmentally suitable instrument grounded in structural, linguistic, and cultural equivalence. Participants were 772 third- and fourth-grade students (388 girls) from six public elementary schools, recruited through convenience sampling. The adaptation process involved forward–backward translation, expert evaluations to ensure semantic, idiomatic, experiential, and conceptual equivalence, a pre-test to verify item clarity, and a pilot study to refine the visual layout. Psychometric properties were examined using Confirmatory Factor Analysis and Exploratory Structural Equation Modeling (ESEM). Results supported a clear three-factor structure with strong model fit indices. ESEM yielded high factor loadings and minimal cross-loadings, confirming distinct constructs. Internal consistency was satisfactory, with Cronbach’s alpha and McDonald’s omega values above .70. Construct validity was supported by acceptable AVE and CR values, and discriminant validity was confirmed. Multi-group CFA demonstrated measurement invariance across gender (male-female) and across grade level (3rd vs. 4th), indicating stable functioning across these groups. Overall, the findings show that the adapted scale is a reliable, valid, and practical instrument for assessing achievement emotions in elementary PE, offering a brief and visually accessible option for evaluating young students’ emotional experiences.

 Achievement emotions Physical education Elementary school Control-value theory Visual scale Bieleke, M., Goetz, T., Yanagida, T., Botes, E., Frenzel, A.C., & Pekrun, R. (2023). Measuring emotions in mathematics: The Achievement Emotions Questionnaire-Mathematics (AEQ-M). ZDM - Mathematics Education, 55(2), 269-284. https://doi.org/10.1007/s11858-022-01425-8 Bieleke, M., Gogol, K., Goetz, T., Daniels, L., & Pekrun, R. (2021). The AEQ-S: A short version of the Achievement Emotions Questionnaire. Contemporary Educational Psychology, 65, Article 101940.https://doi.org/10.1016/j.cedpsych.2020.101940 Byrne, B.M. (2016). Structural equation modeling with AMOS: Basic concepts, applications, and programming (3rd ed.). Routledge. Camacho-Morles, J., Slemp, G.R., Pekrun, R., Loderer, K., Hou, H., & Oades, L.G. (2021). Activity achievement emotions and academic performance: A meta-analysis. Educational Psychology Review, 33(3), 1051-1095. https://doi.org/10.1007/s10648-020-09585-3 Cañabate, D., Martínez, G., Rodríguez, D., & Colomer, J. (2018). Analysing emotions and social skills in physical education. Sustainability, 10(5), Article 1585. https://doi.org/10.3390/su10051585 Ceylan, M., & Karlı, Ü. (2024). Adaptation of the achievement emotions questionnaire for physical education (AEQ- PE) to the Turkish language. Journal of Sport Sciences Research, 9(2), 132-148. https://doi.org/10.25307/jssr.1416025 DeVellis, R.F., & Thorpe, C.T. (2021). Scale development: Theory and applications (5th ed.). Sage publications. Espoz-Lazo, S., Rodríguez Huete, R., Espoz-Lazo, P., Farías-Valenzuela, C., & Valdivia-Moral, P. (2020). Emotional education for the development of primary and secondary school students through physical education: Literature review. Education Sciences, 10(8), Article 192. https://doi.org/10.3390/educsci10080192 Fierro-Suero, S., Almagro, B.J., & Sáenz-López, P. (2020). Validation of the achievement emotions questionnaire for physical education (AEQ-PE). International Journal of Environmental Research and Public Health, 17(12), 1-12. https://doi.org/10.3390/ijerph17124560 Fornell, C., & Larcker, D.F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39 50. https://doi.org/10.1177/002224378101800104 Fraenkel, J.R., Wallen, N.E., & Hyun, H.H. (2012). How to design and evaluate research in education (8th ed.). McGraw-Hill. Garn, A.C., Simonton, K., Dasingert, T., & Simonton, A. (2017). Predicting changes in student engagement in university physical education: Application of control-value theory of achievement emotions. Psychology of Sport and Exercise, 29, 93 102. https://doi.org/10.1016/j.psychsport.2016.12.005 Hambleton, R.K., & Patsula, L. (1999). Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. Journal of Applied Testing Technology, 1(1), 1-30. Hu, L.T., & Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424. https://doi.org/10.1037/1082-989X.3.4.424 Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118 Lichtenfeld, S., Pekrun, R., Stupnisky, R.H., Reiss, K., & Murayama, K. (2012). Measuring students’ emotions in the early years: The achievement emotions questionnaire-elementary school (AEQ-ES). Learning and Individual Differences, 22(2), 190-201. https://doi.org/10.1016/j.lindif.2011.04.009 Lin, L.C., Huang, P.H., & Weng, L.J. (2017). Selecting path models in SEM: A comparison of model selection criteria. Structural Equation Modeling: A Multidisciplinary Journal, 24(6), 855-869. https://doi.org/10.1080/10705511.2017.1363652 Marsh, H.W., Morin, A.J.S., Parker, P.D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700 Morin, A.J.S., Arens, A.K., & Marsh, H.W. (2016). A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Structural Equation Modeling: A Multidisciplinary Journal, 23(1), 116-139. https://doi.org/10.1080/10705511.2014.961800 Morin, A.J.S., Boudrias, J.S., Marsh, H.W., McInerney, D.M., Dagenais-Desmarais, V., Madore, I., & Litalien, D. (2017). Complementary variable- and person-centered approaches to the dimensionality of psychometric constructs: Application to psychological wellbeing at work. Journal of Business and Psychology, 32(4), 395-419. https://doi.org/10.1007/s10869-016-9448-7 Muthén, L.K., & Muthén, B.O. (2017). Mplus User’s Guide (8th ed.). Muthén & Muthén. Navarro, N., Trigueros, R., González-Bernal, J.J., & Caggiano, V. (2024). A psychometric evaluation of the achievement emotion questionnaire - short version in the context of Italian physical education. Perceptual and Motor Skills, 131(5), 1984-2007. https://doi.org/10.1177/00315125241274820 Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315-341. https://doi.org/10.1007/s10648-006-9029-9 Pekrun, R. (2024). Control-value theory: From achievement emotion to a general theory of human emotions. Educational Psychology Review, 36(3), 83. https://doi.org/10.1007/s10648-024-09909-7 Pekrun, R., Goetz, T., Frenzel, A.C., Barchfeld, P., & Perry, R.P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36 48. https://doi.org/10.1016/j.cedpsych.2010.10.002 Pekrun, R., Marsh, H.W., Elliot, A.J., Stockinger, K., Perry, R.P., Vogl, E., Tilburg, W.A.P. van, Goetz, T., Lüdtke, O., & Vispoel, W.P. (2023). A three-dimensional taxonomy of achievement emotions. Journal of Personality and Social Psychology: Personality Processes and Individual Differences, 124(1), 145-178. https://doi.org/10.1037/pspp0000448.supp Reise, S.P., Bonifay, W.E., & Haviland, M.G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129 140. https://doi.org/10.1080/00223891.2012.725437 Pituch, K.A., & Stevens, J.P. (2015). Applied Multivariate Statistics for the Social Sciences (3rd ed.). Lawrence Erlbaum. https://doi.org/10.4324/9781315814919 Shao, K., Stockinger, K., Marsh, H.W., & Pekrun, R. (2023). Applying control-value theory for examining multiple emotions in L2 classrooms: Validating the Achievement Emotions Questionnaire – Second Language Learning. Language Teaching Research, 94(1), 35 44. https://doi.org/10.1177/13621688221144497 Simonton, K.L., & Garn, A. (2019). Exploring achievement emotions in physical education: The potential for the control value theory of achievement emotions. Quest, 71(4), 434 446. https://doi.org/10.1080/00336297.2018.1542321 Simonton, K.L., & Garn, A.C. (2020). Negative emotions as predictors of behavioral outcomes in middle school physical education. European Physical Education Review, 26(4), 764 781. https://doi.org/10.1177/1356336X19879950 Simonton, K.L., Garn, A.C., & Layne, T.E. (2024). An investigation of content-specific unit emotions in secondary physical education. Education Sciences, 14(10), Article 1123. https://doi.org/10.3390/educsci14101123 Simonton, K.L., Garn, A.C., & Mercier, K.J. (2023). Expanding the discrete emotions in physical education scale (DEPES): Evaluating emotions with behavior and learning. Research Quarterly for Exercise and Sport, 94(1), 35-44. https://doi.org/10.1080/02701367.2021.1935434 Sousa, V.D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268-274. https://doi.org/10.1111/j.1365-2753.2010.01434.x Streiner, D.L., Norman, G.R., & Cairney, J. (2024). Health measurement scales: A practical guide to their development and use (6th ed.). Oxford University Press. https://doi.org/10.1093/med/9780192869487.001.0001 van Zyl, L.E., & ten Klooster, P.M. (2022). Exploratory Structural Equation Modeling: Practical guidelines and tutorial with a convenient online tool for Mplus. Frontiers in Psychiatry, 12, 1-28. https://doi.org/10.3389/fpsyt.2021.795672 Wright, P.M., Gordon, B., & Gray, S. (2020). Social and emotional learning in the physical education curriculum. In Oxford Research Encyclopedia of Education. Oxford University Press. https://doi.org/10.1093/acrefore/9780190264093.013.1061