Development and validation of STEM motivation scale for middle school students

Öz

Understanding motivational beliefs such as expectancy and value that shape students’ persistence and decision to pursue a STEM career, obtaining valid and reliable measures for these dimensions, and developing strategies using this data are critically important to ensure students’ persistence in the STEM pipeline. Therefore, this study aims to develop a tool to measure middle school students’ STEM motivations within the expectancy and value concepts framework. The trial version of the scale was conducted on 967 middle school students in the 5th, 6th, 7th, and 8th grades. The study group was randomly divided into two groups. EFA was conducted on the data obtained from the first sub-group (n=479), and CFA was performed using the data obtained from the second sub-group (n=488). The results of a series of CFA performed to test three different models developed based on the theoretical structure, Model 3, the second-order single-factor structure composed of 5 sub-dimensions was found to be a successful model. This measurement tool would allow determining motivational beliefs within the expectancy-value concept that can be targeted to encourage students’ interest in STEM fields, as well as help design interventions for these structure(s), and evaluate the effectiveness of these interventions.

Anahtar Kelimeler

• Expectancy value theory
• Motivation
• Scale development
• STEM.

References

1. Açıksöz, A., Özkan, Y., & Dökme, İ. (2020). Adaptation of the STEM value-expectancy assessment scale to Turkish culture. International Journal of Assessment Tools in Education, 7(2), 177-190. https://doi.org/10.21449/ijate.723408
2. Appianing J., & van Eck, R.N. (2018). Development and validation of the Value-Expectancy STEM Assessment Scale for students in higher education. International Journal of STEM Education, 5(24), 1-16. https://doi.org/10.1186/s40594-018-0121-8
3. Areepattamannil, S., Freeman, J.G., & Klinger, D.A. (2010). Influence of motivation, self-beliefs, and instructional practices on science achievement of adolescents in Canada. Social Psychology of Education, 14(2), 233–259. https://doi.org/10.1007/s11218-010-9144-9
4. Ball, C., Huang, K.T., Cotten, S.R., & Rikard, R.V. (2017). Pressurizing the STEM pipeline: An expectancy-value theory analysis of youths’ STEM attitudes. Journal of Science Education and Technology, 26(4), 372-382. https://doi.org/10.1007/s10956-017-9685-1
5. Bandura, A. (1997). Self-efficacy: The exercise of control. W H Freeman/Times Books/ Henry Holt & Co.
6. Barron, K.E., & Hulleman, C.S. (2015). Expectancy-Value-Cost model of motivation. In J.D. Wright (Ed.), International encyclopedia of the social & behavioral sciences, (2nd Ed., Vol.8, pp. 503-509). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.26099-6
7. Barutcu, T. (2017). Beklenti-değer temelli öğretimde yazma becerileri ve motivasyon ilişkisi [The relation between writing skills and motivation in teaching based upon the expectancy-value] [Doctoral dissertation, Gazi University].
8. Beerenwinkel, A., & von Arx, M. (2017). Constructivism in practice: An exploratory study of teaching patterns and student motivation in physics classrooms in Finland, Germany and Switzerland. Research in Science Education, 47, 237 255. http://doi.org/10.1007/s11165-015-9497-3

9. Bergh, D. (2015). Chi-Squared test of fit and sample size: A comparison between a random sample approach and a chi-square value adjustment method. Journal of Applied Measurement, 16(2), 204–217.
10. Bøe, M.V., Henriksen, E.K., Lyons, T., & Schreiner, C. (2011). Participation in science and technology: Young people’s achievement-related choices in late modern societies. Studies in Science Education, 47(1), 1 36. https://doi.org/10.1080/03057267.2011.549621
11. Breiner, J., Harkness, S., Johnson, C., & Koehler, C. (2012). What is STEM? A discussion about conceptions of STEM in education and partnerships. School Science and Mathematics, 112(1), 3–11. https://doi.org/10.1111/j.1949-8594.2011.00109.x
12. Brown, T.A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
13. Brown, P.L., Concannon, J.P., Marx, D., Donaldson, C., & Black, A. (2016). An examination of middle school students' STEM self-efficacy, interests and perceptions. Journal of STEM Education: Innovations and Research, 17(3), 27-38
14. Bybee, R.W. (2010). What is STEM education?. Science, 329(5995), 996.
15. Chen, J.A., & Dede, C.J. (2011). Youth STEM motivation: Immersive technologies to engage and empower underrepresented students. In Conference proceeding TEST Learning Resource Center at EDC. Retrieved February 15, 2022 from https://publish.wm.edu/workingpapers/1
16. Corlu, M.S., Capraro, R.M., & Capraro, M.M. (2014). Introducing STEM education: Implications for educating our teachers in the age of innovation. Education and Science, 39(171), 74-85.
17. Christensen, R., & Knezek, G. (2017). Relationship of middle school student STEM interest to career intent. Journal of Education in Science, Environment and Health (JESEH), 3(1), 1-13. https://doi.org/10.21891/jeseh.275649
18. Dabney, K.P., Tai, R.H., Almarode, J.T., Miller-Friedmann, J.L., Sonnert, G., Sadler, P.M., & Hazari, Z. (2012). Out-of-school time science activities and their association with career interest in STEM. International Journal of Science Education, Part B, 2(1), 63–79. https://doi.org/10.1080/21548455.2011.629455
19. DeVellis, R.F. (2003). Scale development theory and applications (2nd Ed.). SAGE Publication.
20. Dotterer, A.M. (2022). Parent involvement, expectancy values, and STEM outcomes among underrepresented adolescents. Social Psychology of Education, 25, 113 127. https://doi.org/10.1007/s11218-021-09677-0
21. Eccles, J.S. (2005). Subjective task value and the Eccles et al. model of achievement-related choices. In A.J. Elliot & C.S. Dweck (Eds.), Handbook of Competence and Motivation (pp. 105-121). Guilford Press.
22. Eccles, J.S. (2011). Gendered educational and occupational choices: Applying the Eccles et al. model of achievement-related choices. International Journal of Behavioral Development, 35(3) 195–201. https://doi.org/10.1177/0165025411398185
23. Eccles-Parsons, J.S., Adler, T.F., Futterman, R., Goff, S.B., Kaczala, C.M., Meece, J.L., & Midgley, C. (1983). Expectancies, values, and academic behaviors. In J.T. Spence (Ed.), Achievement and achievement motives (pp. 75-146). W.H. Freeman.
24. Eccles, J.S., & Harold, R.D. (1991). Gender differences in sport involvement: Applying the Eccles’ expectancy-value model. Journal of Applied Sport Psychology, 3, 7-35. https://doi.org/10.1080/10413209108406432
25. Eccles, J.S., Roeser, R., Wigfield, A., & Freedman-Doan, C. (1999). Academic and motivational pathways through middle childhood. In L. Balter & C.S. Tamis-LeMonda (Eds.), Child psychology: A handbook of contemporary issues (pp. 287-317). Psychology Press.
26. Eccles, J.S., & Wigfield, A. (1995). In the mind of the actor: The structure of adolescents' achievement task values and expectancy-related beliefs. Personality and Social Psychology Bulletin, 21(3), 215–225.
27. Eccles, J.S., & Wigfield, A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53, 109-132. https://doi.org/10.1146/annurev.psych.53.100901.135153
28. Eccles, J.S., & Wigfield, A. (2020). From expectancy-value theory to situated expectancy-value theory: A developmental, social cognitive, and sociocultural perspective on motivation. Contemporary Educational Psychology, 61, 101859. https://doi.org/10.1016/j.cedpsych.2020.101859
29. English, L.D. (2017) Advancing elementary and middle school STEM education. International Journal of Education in Mathematics, Science and Technology, 15(1), 5-24. https://doi.org/10.1007/s10763-017-9802-x
30. French, A.M., Else-Quest, N.M., Asher, M., Thoman, D.B., Smith, J.L., Hyde, J.S., & Harackiewicz, J.M. (2023). An intersectional application of expectancy-value theory in an undergraduate chemistry course. Psychology of Women Quarterly, 47(3), 299-319.
31. Glynn, S.M., Brickman, P., Armstrong, N., & Taasoobshirazi, G. (2011). Science motivation questionnaire II: Validation with science majors and non-science majors. Journal of Research in Science Teaching, 48(10), 1159-1176. https://doi.org/10.1002/tea.20442
32. Gok, T. (2021). The development of the STEM (science, technology, engineering, and mathematics) attitude and motivation survey towards secondary school students. International Journal of Cognitive Research in Science, Engineering and Education, 9(1), 105-119. https://doi.org/10.23947/2334-8496-2021-9-1-105-119
33. Gonzalez, H.B., & Kuenzi, J.J. (2012). Science, technology, engineering, and mathematics (STEM) education: A primer. Congressional Research Service, Library of Congress. Washington, DC. http://www.fas.org/sgp/crs/misc/R42642.pdf
34. Gråstén, A. (2016). Children’s expectancy beliefs and subjective task values through two years of school-based program and associated links to physical education enjoyment and physical activity. Journal of Sport and Health Science, 5(4), 500-509.
35. Griffith, A.L. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Economics of Education Review, 29(6), 911 922. https://doi.org/10.1016/j.econedurev.2010.06.010
36. Hermans, S., Gijsen, M., Mombaers, T., & van Petegen, P. (2022). Gendered patterns in students’ motivation profiles regarding iSTEM and STEM test scores: A cluster analysis. International Journal of STEM Education, 9, 67. https://doi.org/10.1186/s40594-022-00379-3
37. Hidi, S., & Renninger, K.A. (2006). The four-phase model of interest development. Educational Psychologist, 41, 111–127. https://doi.org/10.1207/s15326985ep4102_4
38. Hinton Jr, A.O., Termini, C.M., Spencer, E.C., Rutaganira, F.U., Chery, D., Roby, R., ... & Palavicino-Maggio, C. B. (2020). Patching the leaks: revitalizing and reimagining the STEM pipeline. Cell, 183(3), 568-575. https://doi.org/10.1016/j.cell.2020.09.029
39. Hossain, M., & Robinson, M.G. (2012). How to motivate US students to pursue STEM (science, technology, engineering and mathematics) careers. US-China Educ Rev A, 4, 442–451.
40. Iversen, M.M., Norekvål, T.M., Oterhals, K., Fadnes, L.T., Mæland, S., Pakpour, A.H., & Breivik, K. (2022). Psychometric properties of the Norwegian version of the fear of COVID-19 Scale. International Journal of Mental Health and Addiction, 1-19. https://doi.org/10.1007/s11469-020-00454-2
41. Jones, B.D. (2009). Motivating students to engage in learning: The MUSIC Model of Academic Motivation. International Journal of Teaching and Learning in Higher Education, 21(2), 272-285.
42. Jones, B.D. (2018). Motivating students by design: Practical strategies for professors (2nd Ed.). CreateSpace.
43. Jones, B.D. (2012/2022, November). User guide for assessing the components of the MUSIC Model of Motivation. http://www.theMUSICmodel.com
44. Joseph, C.H., Anikelechi, I.G., & Marumo, P. (2019). Academic motivation of school going adolescents: Gender and age difference. Gender and Behaviour, 17(1), 12306-12315.
45. Kaiser, H.F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141 151. https://doi.org/10.1177/001316446002000116
46. Kenny, D. (2015). Measuring model fit. Retrieved March 10, 2023, from http://davidakenny.net/cm/fit.htm
47. Kızılay, E., Yamak, H., & Kavak, N. (2019). Motivation scale for STEM fields. Journal of Computer and Education Research, 7(14), 540-557. https://doi.org/10.18009/jcer.617514
48. Kosovich, J.J., Hulleman, C.S., Barron, K.E., & Getty, S. (2015). A practical measure of student motivation: Establishing validity evidence for the Expectancy-Value-Cost Scale in middle school. The Journal of Early Adolescence, 35(5 6), 790 816. https://doi.org/10.1177/0272431614556890
49. Kuenzi, J. (2008). Science, technology, engineering, and mathematics (STEM) education: Background, federal policy and legislative action. Congressional Research Service Reports. Retrieved February 10, 2022 from http://digitalcommons.unl.edu/crsdocs/35/
50. Kulwinder Singh, K. (2014). Motivational beliefs and academic achievement of university students. IOSR Journal of Research & Method in Education, 4(1), 1-3.
51. Kuo, H.C., Tseng, Y.C., & Yang, Y.T.C. (2019). Promoting college student’s learning motivation and creativity through a STEM interdisciplinary PBL human-computer interaction system design and development course. Thinking Skills and Creativity, 31, 1-10. https://doi.org/10.1016/j.tsc.2018.09.001
52. Knezek, G., Christensen, R., Tyler-Wood, T., & Periathiruvadi, S. (2013). Impact of environmental power monitoring activities on middle school student perceptions of STEM. Science Education International, 24(1), 98-123.
53. Langdon, D., McKittrick, G., Beede, D., Khan, B., & Doms, M. (2011). STEM: Good jobs now and for the future (ESA Issue Brief 03-11). U.S. Department of Commerce. Economics and Statistics Administration. https://files.eric.ed.gov/fulltext/ED522129.pdf
54. Loh, E.K. (2019). What we know about expectancy-value theory, and how it helps to design a sustained motivating learning environment. System, 86, 102119.
55. Luo, T., So, W.W.M., Wan, Z.H., & Li, W.C. (2021). STEM stereotypes predict students’ STEM career interest via self-efficacy and outcome expectations. International Journal of STEM Education, 8(1), 1-13. https://doi.org/10.1186/s40594-021-00295-y
56. Luo, T., Wang, J., Liu, X., & Zhou, J. (2019). Development and application of a scale to measure students’ STEM continuing motivation. International Journal of Science Education, 41(14), 1885-1904. https://doi.org/10.1080/09500693.2019.1647472
57. Meyer, J., Fleckenstein, J., & Köller, O. (2019). Expectancy value interactions and academic achievement: Differential relationships with achievement measures. Contemporary Educational Psychology, 58, 58–74. https://doi.org/10.1016/j.cedpsych.2019.01.006
58. Moreno, N.P., Tharp, B.Z., Vogt, G., Newell, A.D., & Burnett, C.A. (2016). Preparing students for middle school through after-school STEM activities. Journal of Science Education and Technology, 25, 889-897. https://doi.org/10.1007/s10956-016-9643-3
59. Nariman, N. (2021). How does an industry-aligned technology-rich problem-based learning (PBL) model influence low-income and native Hawaiian student’s STEM career interest?. Journal of Problem Based Learning in Higher Education, 9(1), 150-178. https://doi.org/10.5278/ojs.jpblhe.v9i1.6367
60. National Research Council [NRC] (2011). Successful K-12 STEM education. Identify effective approaches in science, technology, engineering and mathematics. The National Academies Press. https://www.ltrr.arizona.edu/webhome/sheppard/TUSD/NRC2011.pdf
61. National Science and Technology Council [NSTC] (2018). Charting a course for success. America’s strategy for STEM education. https://www.whitehouse.gov/wp-content/uploads/2018/12/STEM-Education-Strategic-Plan-2018.pdf
62. PCAST (2010). Prepare and Inspire: K-12 Education in Science, Technology, Engineering, and Math (STEM) Education for America’s Future Executive Report. National Science Foundation. https://nsf.gov/attachments/117803/public/2a--Prepare_and_Inspire--PCAST.pdf
63. Partridge, J., Brustad, R., & Stellino, M.B. (2013). Theoretical perspectives: Eccles’s expectancy value theory. Advances in Sport Psychology, 3, 269-292.
64. Perez, T., Wormington, S.V., Barger, M.M., Schwartz-Bloom, R.D., Lee, Y., & Linnenbrink-Garcia, L. (2019). Science expectancy, value, and cost profiles and their proximal and distal relations to undergraduate science, technology, engineering, and math persistence. Science Education, 103, 264-286. https://doi.org/10.1002/sn.21490
65. Petri, H.L., & Govern, J.M. (2013). Motivation: Theory, research, and application (6th ed.). Wadsworth Cenpage Learning.
66. Razali, F. (2021). Exploring crucial factors of an interest in STEM career model among secondary school students. International Journal of Instruction, 14(2), 385-404. https://doi.org/10.29333/iji.2021.14222a
67. Robnett., R.D., & Leaper, C. (2012). Friendship groups, personal motivation, and gender in relation to high school students’ STEM career. Interest Journal of Research on Adolescence, 23(4), 652–664. https://doi.org/10.1111/jora.12013
68. Romine, W.L., & Sadler, T.D. (2016). Measuring changes in interest in science and technology at the college level in response to two instructional interventions. Research in Science Education. 46(3), 309-327.
69. Rosenzweig, E.Q., & Wigfield, A. (2016). STEM motivation interventions for adolescents: A promising start, but further to go. Educational Psychologist, 51(2), 146-163.
70. Rosenzweig, E.Q., Wigfield, A., & Eccles J.S. (2019). Expectancy – value theory and its relevance for student motivation and learning. In K.A. Renninger & S.E. Hidi (Eds.), The Cambridge handbook of motivation and learning (pp. 617-644). Cambridge University Press. https://doi.org/10.1017/9781316823279.026
71. Rozek, C.S., Svoboda, R.C., Harackiewicz, J.M., Hulleman, C.S., & Hyde, J.S. (2017). Utility-value intervention with parents’ increases students’ STEM preparation and career pursuit. Proceedings of the National Academy of Sciences, 114(5), 909 914. https://doi.org/10.1073/pnas.1607386114
72. Sadler, P.M., Sonnert, G., Hazari, Z., & Tai, R. (2012). Stability and volatility of stem career interest in high school: A gender study. Science Education, 96(3), 411–427. https://doi.org/10.1002/sce.21007
73. Sanders, M. (2009). STEM, STEM education, STEMmania. The Technology Teacher, 68(4), 20-26.
74. Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8(2), 23–74.
75. Schoenherr, J. (2024). Personalizing real-world problems: Posing own problems increases self-efficacy expectations, intrinsic value, attainment value, and utility value. British Journal of Educational Psychology, 1-18.
76. Shin, D.D., Lee, M., Ha, J.E., Park, J.H., Ahn, H.S., Son, E., Chung, Y., & Bong, M. (2019). Science for all: Boosting the science motivation of elementary school students with utility value intervention. Learning and Instruction. 60, 104 116. https://doi.org/10.1016/j.learninstruc.2018.12.003
77. Steinmayr, R., Weidinger, A.F., Schwinger, M., & Spinath, B. (2019). The importance of students’ motivation for their academic achievement: Replicating and extending previous findings. Frontiers in Psychology, 10, 1730. https://doi.org/10.3389/fpsyg.2019.01730
78. Şimşek, Ö.F. (2007). Yapısal eşitlik modellemesine giriş: Temel ilkeler ve LISREL uygulamaları [Introduction to structural equation modeling: Basic principles and LISREL applications]. Ekinoks Yayınları, Ankara.
79. Tabachnick, B.G., & Fidell, L.S. (2007). Using multivariate statistics. Pearson Education, Inc.
80. Tai, R., Liu, C., Maltese, A., & Fan, X. (2006). Planning early for careers in science. Science, 312(5777), 1143- 1144. https://doi.org/10.1126/science.1128690
81. Trautwein, U., Marsh, H.W., Nagengast, B., Lüdtke, O., Nagy, G., & Jonkmann, K. (2012). Probing for the multiplicative term in modern expectancy–value theory: A latent interaction modeling study. Journal of Educational Psychology, 104(3), 763–777. https://doi.org/10.1037/a0027470
82. Valenzuela, J., Nieto, A.M., & Saiz, C. (2011). Critical thinking motivational scale: a contribution to the study of relationship between critical thinking and motivation. Journal of Research in Educational Psychology, 9(2), 823 848. https://doi.org/10.25115/ejrep.v9i24.1475
83. Van den Hurk, A., Meelissen, M., & Van Langen, A. (2019). Interventions in education to prevent STEM pipeline leakage. International Journal of Science Education, 41(2), 150-164. https://doi.org/10.1080/09500693.2018.1540897
84. Walters, S., Santana, C., Zastavker, Y.V., Dillon, A., Stolk, J.D., & Gross, M.D. (2016). Students' motivational attitudes in introductory STEM courses: The relationship between assessment and externalization. In 2016 IEEE Frontiers in Education Conference (FIE) (pp. 1-4). IEEE.
85. Waltz, C.F., Strickland, O., & Lenz, E.R. (2010). Measurement in nursing and health research. Springer Publishing Company, New York.
86. Wang, M., & Degol, J. (2013). Motivational pathways to STEM career choices: Using expectancy–value perspective to understand individual and gender differences in STEM fields. Developmental Review, 33(4), 1-37. https://doi.org/10.1016/j.dr.2013.08.001
87. Wang, X. (2013). Why students choose STEM majors: Motivation, high school learning, and postsecondary context of support. American Educational Research Journal, 50(5), 1081-1121. https://doi.org/10.3102/0002831213488622
88. Wentzel, K.R., & Wigfield, A. (1998). Academic and social motivational influences on students' academic performance. Educational Psychology Review, 10(2), 155-175. https://doi.org/10.1023/A:1022137619834
89. Wigfield, A. (1994). Expectancy-value theory of achievement motivation: A developmental perspective. Educational Psychology Review, 6(1), 49 78. https://doi.org/10.1007/BF02209024
90. Wigfield, A., & Cambria, J. (2010). Students’ achievement values, goal orientations, and interest: Definitions, development, and relations to achievement outcomes. Developmental Review, 30, 1–35. https://doi.org/10.1016/j.dr.2009.12.001
91. Wigfield, A., & Eccles, J.S. (1992). The development of achievement task values: A theoretical analysis. Developmental Review, 12, 265-310. https://doi.org/10.1016/0273-2297(92)90011-P
92. Wigfield, A., & Eccles, J.S. (2000). Expectancy–value theory of achievement motivation. Contemporary Educational Psychology, 25, 68 81. https://doi.org/10.1006/ceps.1999.1015
93. Wigfield, A., & Eccles, J.S. (2002). The development of competence beliefs, expectancies for success, and achievement values from childhood through adolescence. In A. Wigfield & J.S. Eccles (Eds.). Development of achievement motivation. Academic Press. https://doi.org/10.1016/B978-012750053-9/50006-1
94. Wigfield, A., & Gladstone, J.R. (2019). What does expectancy-value theory have to say about motivation and achievement in times of change and uncertainty?. In E. N. Gonida & M. S. Lemos (Eds.), Motivation in Education at a Time of Global Change (pp. 15–32). Emerald. https://doi.org/10.1108/s0749-742320190000020002
95. Wigfield, A., Rosenzweig, E.Q., & Eccles, J.S. (2017). Achievement values: Interactions, interventions, and future direction. In A.J. Elliot, C.S. Dweck & D.S. Yeager (Eds.), Handbook of competence and motivation: Theory and application (116–134). The Guilford Press.
96. Wigfield, A., Tonks, S., & Klauda, S.L. (2009). Expectancy-value theory. In K.R. Wentzel & A. Wigfield (Eds.), Educational psychology handbook series. Handbook of motivation at school (pp. 55–75). Routledge/Taylor & Francis Group.
97. Williams, K.C., & Williams, C.C. (2011). Five key ingredients for improving student motivation. Research in Higher Education Journal, 12, 1-23.
98. Wu, F., & Fan, W. (2017). Academic procrastination in linking motivation and achievement-related behaviours: A perspective of expectancy value theory. Educational Psychology, 37(6), 695-711.
99. Xiang, P., Mcbride, R., Guan, J., & Solmon, M. (2003). Children’s motivation in elementary physical education: An expectancy-value model of achievement choice. Research Quarterly for Exercise and Sport, 74, 25 35. https://doi.org/10.1080/02701367.2003.10609061
100. Yahaya, J., Fadzli, S., Deraman, A., Yahaya, N.Z., Halim, L., Rais, I.A.I., & Ibrahim, S.R.A. (2022). RInK: Environmental virtual interactive based education and learning model for STEM motivation. Educ Inf Technol, 27, 4771–4791. https://doi.org/10.1007/s10639-021-10794-8
101. Yurt, E. (2016). Examination of task values and expectancy beliefs of middle school students towards mathematics. International Online Journal of Educational Sciences, 8(1), 200-215.