The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School

Mehmet Ceylan; Kevser Ceylan; Oguzhan Yoncalık

doi:10.21449/ijate.1730488

The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School

Abstract

Achievement emotions such as enjoyment, anxiety, and boredom significantly influence students’ motivation, engagement, and performance in physical education (PE). Despite growing interest in academic emotions, age-appropriate tools for younger students remain limited. This study aimed to adapt and validate a brief, visually supported scale to assess enjoyment, anxiety, and boredom in PE. The goal was to develop a developmentally suitable instrument grounded in structural, linguistic, and cultural equivalence. Participants were 772 third- and fourth-grade students (388 girls) from six public elementary schools, recruited through convenience sampling. The adaptation process involved forward–backward translation, expert evaluations to ensure semantic, idiomatic, experiential, and conceptual equivalence, a pre-test to verify item clarity, and a pilot study to refine the visual layout. Psychometric properties were examined using Confirmatory Factor Analysis and Exploratory Structural Equation Modeling (ESEM). Results supported a clear three-factor structure with strong model fit indices. ESEM yielded high factor loadings and minimal cross-loadings, confirming distinct constructs. Internal consistency was satisfactory, with Cronbach’s alpha and McDonald’s omega values above .70. Construct validity was supported by acceptable AVE and CR values, and discriminant validity was confirmed. Multi-group CFA demonstrated measurement invariance across gender (male-female) and across grade level (3rd vs. 4th), indicating stable functioning across these groups. Overall, the findings show that the adapted scale is a reliable, valid, and practical instrument for assessing achievement emotions in elementary PE, offering a brief and visually accessible option for evaluating young students’ emotional experiences.

Keywords

Ethical Statement

Ethics Committee of Kırıkkale University (Date and Approval No: 14/02/2025-315939).

References

Bieleke, M., Goetz, T., Yanagida, T., Botes, E., Frenzel, A.C., & Pekrun, R. (2023). Measuring emotions in mathematics: The Achievement Emotions Questionnaire-Mathematics (AEQ-M). ZDM - Mathematics Education, 55(2), 269-284. https://doi.org/10.1007/s11858-022-01425-8
Bieleke, M., Gogol, K., Goetz, T., Daniels, L., & Pekrun, R. (2021). The AEQ-S: A short version of the Achievement Emotions Questionnaire. Contemporary Educational Psychology, 65, Article 101940.https://doi.org/10.1016/j.cedpsych.2020.101940
Byrne, B.M. (2016). Structural equation modeling with AMOS: Basic concepts, applications, and programming (3rd ed.). Routledge.
Camacho-Morles, J., Slemp, G.R., Pekrun, R., Loderer, K., Hou, H., & Oades, L.G. (2021). Activity achievement emotions and academic performance: A meta-analysis. Educational Psychology Review, 33(3), 1051-1095. https://doi.org/10.1007/s10648-020-09585-3
Cañabate, D., Martínez, G., Rodríguez, D., & Colomer, J. (2018). Analysing emotions and social skills in physical education. Sustainability, 10(5), Article 1585. https://doi.org/10.3390/su10051585
Ceylan, M., & Karlı, Ü. (2024). Adaptation of the achievement emotions questionnaire for physical education (AEQ- PE) to the Turkish language. Journal of Sport Sciences Research, 9(2), 132-148. https://doi.org/10.25307/jssr.1416025
DeVellis, R.F., & Thorpe, C.T. (2021). Scale development: Theory and applications (5th ed.). Sage publications.
Espoz-Lazo, S., Rodríguez Huete, R., Espoz-Lazo, P., Farías-Valenzuela, C., & Valdivia-Moral, P. (2020). Emotional education for the development of primary and secondary school students through physical education: Literature review. Education Sciences, 10(8), Article 192. https://doi.org/10.3390/educsci10080192

Fierro-Suero, S., Almagro, B.J., & Sáenz-López, P. (2020). Validation of the achievement emotions questionnaire for physical education (AEQ-PE). International Journal of Environmental Research and Public Health, 17(12), 1-12. https://doi.org/10.3390/ijerph17124560
Fornell, C., & Larcker, D.F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39 50. https://doi.org/10.1177/002224378101800104
Fraenkel, J.R., Wallen, N.E., & Hyun, H.H. (2012). How to design and evaluate research in education (8th ed.). McGraw-Hill.
Garn, A.C., Simonton, K., Dasingert, T., & Simonton, A. (2017). Predicting changes in student engagement in university physical education: Application of control-value theory of achievement emotions. Psychology of Sport and Exercise, 29, 93 102. https://doi.org/10.1016/j.psychsport.2016.12.005
Hambleton, R.K., & Patsula, L. (1999). Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. Journal of Applied Testing Technology, 1(1), 1-30.
Hu, L.T., & Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424. https://doi.org/10.1037/1082-989X.3.4.424
Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Lichtenfeld, S., Pekrun, R., Stupnisky, R.H., Reiss, K., & Murayama, K. (2012). Measuring students’ emotions in the early years: The achievement emotions questionnaire-elementary school (AEQ-ES). Learning and Individual Differences, 22(2), 190-201. https://doi.org/10.1016/j.lindif.2011.04.009
Lin, L.C., Huang, P.H., & Weng, L.J. (2017). Selecting path models in SEM: A comparison of model selection criteria. Structural Equation Modeling: A Multidisciplinary Journal, 24(6), 855-869. https://doi.org/10.1080/10705511.2017.1363652
Marsh, H.W., Morin, A.J.S., Parker, P.D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
Morin, A.J.S., Arens, A.K., & Marsh, H.W. (2016). A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Structural Equation Modeling: A Multidisciplinary Journal, 23(1), 116-139. https://doi.org/10.1080/10705511.2014.961800
Morin, A.J.S., Boudrias, J.S., Marsh, H.W., McInerney, D.M., Dagenais-Desmarais, V., Madore, I., & Litalien, D. (2017). Complementary variable- and person-centered approaches to the dimensionality of psychometric constructs: Application to psychological wellbeing at work. Journal of Business and Psychology, 32(4), 395-419. https://doi.org/10.1007/s10869-016-9448-7
Muthén, L.K., & Muthén, B.O. (2017). Mplus User’s Guide (8th ed.). Muthén & Muthén.
Navarro, N., Trigueros, R., González-Bernal, J.J., & Caggiano, V. (2024). A psychometric evaluation of the achievement emotion questionnaire - short version in the context of Italian physical education. Perceptual and Motor Skills, 131(5), 1984-2007. https://doi.org/10.1177/00315125241274820
Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315-341. https://doi.org/10.1007/s10648-006-9029-9
Pekrun, R. (2024). Control-value theory: From achievement emotion to a general theory of human emotions. Educational Psychology Review, 36(3), 83. https://doi.org/10.1007/s10648-024-09909-7
Pekrun, R., Goetz, T., Frenzel, A.C., Barchfeld, P., & Perry, R.P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36 48. https://doi.org/10.1016/j.cedpsych.2010.10.002
Pekrun, R., Marsh, H.W., Elliot, A.J., Stockinger, K., Perry, R.P., Vogl, E., Tilburg, W.A.P. van, Goetz, T., Lüdtke, O., & Vispoel, W.P. (2023). A three-dimensional taxonomy of achievement emotions. Journal of Personality and Social Psychology: Personality Processes and Individual Differences, 124(1), 145-178. https://doi.org/10.1037/pspp0000448.supp
Reise, S.P., Bonifay, W.E., & Haviland, M.G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129 140. https://doi.org/10.1080/00223891.2012.725437
Pituch, K.A., & Stevens, J.P. (2015). Applied Multivariate Statistics for the Social Sciences (3rd ed.). Lawrence Erlbaum. https://doi.org/10.4324/9781315814919
Shao, K., Stockinger, K., Marsh, H.W., & Pekrun, R. (2023). Applying control-value theory for examining multiple emotions in L2 classrooms: Validating the Achievement Emotions Questionnaire – Second Language Learning. Language Teaching Research, 94(1), 35 44. https://doi.org/10.1177/13621688221144497
Simonton, K.L., & Garn, A. (2019). Exploring achievement emotions in physical education: The potential for the control value theory of achievement emotions. Quest, 71(4), 434 446. https://doi.org/10.1080/00336297.2018.1542321
Simonton, K.L., & Garn, A.C. (2020). Negative emotions as predictors of behavioral outcomes in middle school physical education. European Physical Education Review, 26(4), 764 781. https://doi.org/10.1177/1356336X19879950
Simonton, K.L., Garn, A.C., & Layne, T.E. (2024). An investigation of content-specific unit emotions in secondary physical education. Education Sciences, 14(10), Article 1123. https://doi.org/10.3390/educsci14101123
Simonton, K.L., Garn, A.C., & Mercier, K.J. (2023). Expanding the discrete emotions in physical education scale (DEPES): Evaluating emotions with behavior and learning. Research Quarterly for Exercise and Sport, 94(1), 35-44. https://doi.org/10.1080/02701367.2021.1935434
Sousa, V.D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268-274. https://doi.org/10.1111/j.1365-2753.2010.01434.x
Streiner, D.L., Norman, G.R., & Cairney, J. (2024). Health measurement scales: A practical guide to their development and use (6th ed.). Oxford University Press. https://doi.org/10.1093/med/9780192869487.001.0001
van Zyl, L.E., & ten Klooster, P.M. (2022). Exploratory Structural Equation Modeling: Practical guidelines and tutorial with a convenient online tool for Mplus. Frontiers in Psychiatry, 12, 1-28. https://doi.org/10.3389/fpsyt.2021.795672
Wright, P.M., Gordon, B., & Gray, S. (2020). Social and emotional learning in the physical education curriculum. In Oxford Research Encyclopedia of Education. Oxford University Press. https://doi.org/10.1093/acrefore/9780190264093.013.1061

Details

Primary Language

English

Subjects

Scale Development

Journal Section

Research Article

Authors

Mehmet Ceylan ^*
0000-0003-0291-4247
Türkiye

Kevser Ceylan
0009-0004-5674-8189
Türkiye

Oguzhan Yoncalık
0000-0003-2289-1257
Türkiye

Early Pub Date

April 2, 2026

Publication Date

-

Submission Date

June 30, 2025

Acceptance Date

February 3, 2026

Published in Issue

Year 2026 Number: Advanced Online Publication

DOI

https://doi.org/10.21449/ijate.1730488

IZ

https://izlik.org/JA46UL59LD

Cite

RIS / Bibtex

APA

Ceylan, M., Ceylan, K., & Yoncalık, O. (2026). The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School. International Journal of Assessment Tools in Education, Advanced Online Publication, 674-688. https://doi.org/10.21449/ijate.1730488

AMA

1.Ceylan M, Ceylan K, Yoncalık O. The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School. Int. J. Assess. Tools Educ. 2026;(Advanced Online Publication):674-688. doi:10.21449/ijate.1730488

Chicago

Ceylan, Mehmet, Kevser Ceylan, and Oguzhan Yoncalık. 2026. “The Adaptation and Validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School”. International Journal of Assessment Tools in Education, no. Advanced Online Publication: 674-88. https://doi.org/10.21449/ijate.1730488.

EndNote

Ceylan M, Ceylan K, Yoncalık O (April 1, 2026) The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School. International Journal of Assessment Tools in Education Advanced Online Publication 674–688.

IEEE

[1]M. Ceylan, K. Ceylan, and O. Yoncalık, “The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School”, Int. J. Assess. Tools Educ., no. Advanced Online Publication, pp. 674–688, Apr. 2026, doi: 10.21449/ijate.1730488.

ISNAD

Ceylan, Mehmet - Ceylan, Kevser - Yoncalık, Oguzhan. “The Adaptation and Validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School”. International Journal of Assessment Tools in Education. Advanced Online Publication (April 1, 2026): 674-688. https://doi.org/10.21449/ijate.1730488.

JAMA

1.Ceylan M, Ceylan K, Yoncalık O. The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School. Int. J. Assess. Tools Educ. 2026;:674–688.

MLA

Ceylan, Mehmet, et al. “The Adaptation and Validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School”. International Journal of Assessment Tools in Education, no. Advanced Online Publication, Apr. 2026, pp. 674-88, doi:10.21449/ijate.1730488.

Vancouver

1.Mehmet Ceylan, Kevser Ceylan, Oguzhan Yoncalık. The adaptation and validation of the Achievement Emotions Questionnaire for Physical Education-Elementary School. Int. J. Assess. Tools Educ. 2026 Apr. 1;(Advanced Online Publication):674-88. doi:10.21449/ijate.1730488