ijesp International Journal of Educational Studies and Policy 2718-1022 Anıl Kadir Eranıl 10.63612/ijesp.1891150 Scale Development Ölçek Geliştirme Development of an Astronomy Achievement Test for Middle School Students https://orcid.org/0000-0001-7987-4904 Konakcı Akın Aykut Milli Eğitim Bakanlığı - Öğretmen https://orcid.org/0000-0002-5789-758X Bektaşlı Behzat HACETTEPE ÜNİVERSİTESİ, EĞİTİM FAKÜLTESİ, MATEMATİK VE FEN BİLİMLERİ EĞİTİMİ BÖLÜMÜ, FEN BİLGİSİ EĞİTİMİ ANABİLİM DALI Advanced Online Publication 170 192 02 17 2026 04 09 2026 Copyright © 2020, International Journal of Educational Studies and Policy 2020 International Journal of Educational Studies and Policy

This study aims to develop a valid and reliable achievement test for astronomy topics incorporated into the 5th and 6th-grade science curriculum, specifically aligned with the Türkiye Century Education Model. Adopting a quantitative research design, the study utilized a relational survey model. Data were collected during the 2025–2026 academic year from a sample of 422 middle school students across three different districts in Türkiye. To ensure content validity, a specification table was developed and validated through expert review. Subsequently, item difficulty indices, upper-lower group mean comparisons, and item–total correlation analyses were performed. The internal consistency of the test, as measured by the KR-20 coefficient, was .859. Corrected item–total correlations ranged from .274 to .480, demonstrating that the items possess a satisfactory level of discriminative power. The finalized Astronomy Achievement Test (AAT), comprising 28 items, stands as a valid and reliable assessment tool that addresses a significant gap in the national science education literature and provides a contemporary framework for astronomy education.

 science education astronomy education astronomy achievement test assessment and evaluation None. None. AERA, APA, & NCME. (2014). Standards for educational and psychological testing. American Educational Research Association. Albayrak, H. (2016). Astronomi konularında istasyon tekniğinin öğrencilerin akademik başarısına ve astronomiye karşı tutumuna etkisi [Yayımlanmamış yüksek lisans tezi]. Erzincan Üniversitesi. Altan, T., Yadigaroğlu, M., & Muştu, Ö. E. (2024). Bir başarı testi geliştirme çalışması: 6. sınıf güneş sistemi ve tutulmalar ünitesi. Fen Bilimleri Öğretimi Dergisi, 12(1), 143-192. https://doi.org/10.56423/fbod.1401126 Bailey, J. M. (2006). Development of a concept inventory to assess students’ understanding and reasoning difficulties about the properties and formation of stars [Unpublished doctoral dissertation]. The University of Arizona. Bailey, J. M., & Slater, T. F. (2003). A review of astronomy education research. Astronomy Education Review, 2(2), 20-45. https://doi.org/10.3847/AER2003015 Bailey, J. M., Johnson, B., Prather, E. E., & Slater, T. F. (2012). Development and validation of the star properties concept ınventory. International Journal of Science Education, 34(14), 2257–2286. https://doi.org/10.1080/09500693.2011.589869 Bardar, E. M., Prather, E. E., Brecher, K., & Slater, T. F. (2006). The development and validation of the light and spectroscopy concept inventory. Astronomy Education Review, 5(2), 103-113. https://doi.org/10.3847/AER2006020 Bekaert, H., Van Winckel, H., Van Dooren, W., Steegen, A., & De Cock, M. (2020). Design and validation of an instrument to test students’ understanding of the apparent motion of the Sun and stars. Physical Review Physics Education Research, 16(2), 020135. https://doi.org/10.1103/PhysRevPhysEducRes.16.020135 Bektaşlı, B. (2013). The development of astronomy concept test for determining preservice science teachers’ misconceptions about astronomy. Education and Science, 38(168). Brogt, E., Sabers, D., Prather, E. E., Deming, G. L., Hufnagel, B., & Slater, T. F. (2007). Analysis of the astronomy diagnostic test. Astronomy Education Review, 1(6), 25-42. https://doi.org/10.3847/AER2007003 Ceylan, E. (2023). Etkileşimli e-kitap destekli ters yüz öğrenme modelinin fen bilgisi öğretmen adaylarının astronomi konularındaki akademik başarı ve ilgisine etkisi. [Yayımlanmamış doktora tezi]. Gazi Üniversitesi. Çiftçibaşı, F., Karamustafaoğlu, S., & Bolat, A. (2023). Güneş sistemi ve tutulmalar ünitesine yönelik başarı testi geliştirilmesi. Gaziantep Üniversitesi Eğitim Bilimleri Dergisi, 7(1), 1-26. Crocker, L., & Algina, J. (2006). Introduction to classical and modern test theory. Harcourt Brace Jovanovich. Deming, G. (2002). Results from the astronomy diagnostic test national project. Astronomy Education Review, 1(1), 52–57. https://doi.org/10.3847/AER2001005 Demir, N. (2020). Astronomi konularının öğretiminde 5E öğrenme modelinin yedinci sınıf öğrencilerinin akademik başarılarına ve tutumlarına etkisi [Yayımlanmamış doktora tezi]. Erciyes Üniversitesi. Demirci, E., & Sevim, S. (2023). Solar system and beyond'unit achievement test: Validity and reliability study. Turkish Journal of Teacher Education, 12(1), 81-100. DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Sage Publications. Doğan, F., & Özdemir, B. (2020). Developing an achievement test about 7th grade solar system and beyon unit: Analysis of validity and reliability. Journal of Computer and Education Research, 8(16), 476-502. https://doi.org/10.18009/jcer.719913 Ebel, R. L. (1979). Essentials of educational measurement. Prentice-Hall. Field, A. (2013). Discovering statistics using IBM SPSS statistics (4th ed.). Sage Publications. Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How to design and evaluate research in education (8th ed.). McGraw-Hill. George, D., & Mallery, P. (2010). SPSS for Windows step by step: A simple guide and reference (17.0 update). Pearson. Greaney, V., & Kellaghan, T. (2008). Assessing national achievement in education: The World Bank primer on large-scale assessment. The World Bank. Guido, R. M. D., & Cruz, R. A. B. D. (2015). Physics diagnostic test: An approach to qualify astronomy students. International Letters of Social and Humanistic Sciences, 63, 129-135. Gündoğdu, T. (2014). 8. sınıf öğrencilerinin astronomi konusundaki başarı ve kavramsal anlama düzeyleri ile fen dersine yönelik tutumları arasındaki ilişkinin incelenmesi. [Yayımlanmamış yüksek lisans tezi]. Marmara Üniversitesi. Hufnagel, B. (2002). Development of the astronomy diagnostic test. Astronomy Education Review, 1(1), 47-51. https://doi.org/10.3847/AER2001004 Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology, 30(1), 17–24. https://doi.org/10.1037/h0057123 Kocataş, Ö. (2023). STEM etkinliklerinin 7. sınıf öğrencilerinin astronomi konusuna ait kavram yanılgılarının giderilmesine ve çeşitli değişkenlere etkisi. [Yayımlanmamış yüksek lisans tezi]. Atatürk Üniversitesi. Lelliott, A., & Rollnick, M. (2010). Big ideas: A review of astronomy education research 1974–2008. International Journal of Science Education, 32(13), 1771-1799. https://doi.org/10.1080/09500690903214546 Liu, C. (2023). A’dan Z’ye astronomi (Çev. M. E. Özel). Say Yayınları. Maran, S. P. (2021). Astronomy for dummies (Çev. S. Aliş, F. K. Yelkenci & B. Coşkunoğlu). Nobel Yaşam Yayınları. Ministry of National Education (2024). Türkiye Century Education Model Science Curriculum (Türkiye Yüzyılı Maarif Modeli: Fen bilimleri dersi öğretim programı, 3–8. sınıflar). https://tymm.meb.gov.tr/ogretim-programlari/fen-bilimleri-dersi Muijs, D. (2011). Doing quantitative research in education with SPSS (2nd ed.). Sage Publications. https://doi.org/10.4135/9781849203241 Percy, J. R. (1998). Astronomy education: An international perspective. L. Gouguenheim, D. McNally & J. R. Percy (Eds), New trends in astronomy teaching (pp. 2-6). Cambridge University Press. https://doi.org/10.1017/CBO9780511628993.004 Percy, J. R. (2009). Teaching and learning astronomy. In J. M. Pasachoff & J. R. Percy (Eds.), Teaching and learning astronomy (pp. 1–15). Cambridge University Press. Roy, A. E., & Clarke, D. C. (1978). Review of publications Astronomy: Principles and practice (Vol. 1) and Astronomy: Structure of the universe (Vol. 2). Journal of the Royal Astronomical Society of Canada, 72(2), 117-117. Sadler, P. M., Coyle, H., Miller, J. L., Cook-Smith, N., Dussault, M., & Gould, R. R. (2010). The astronomy and space science concept inventory: development and validation of assessment instruments aligned with the k–12 national science standards. Astronomy Education Review, 8(1), 010111. https://doi.org/10.3847/AER2009024 Schoon, K. J. (1992). Students’ alternative conceptions of earth and space. Journal of Geological Education, 40(3), 209–214. https://doi.org/10.5408/0022-1368-40.3.209 Şenel-Çoruhlu, T. (2013). Güneş sistemi ve ötesi uzay bilmecesi ünitesinde zenginleştirilmiş 5E öğretim modeline göre geliştirilen rehber materyallerin etkililiğinin belirlenmesi [Yayımlanmamış doktora tezi]. Karadeniz Teknik Üniversitesi. Slater, S. J. (2014). The development and validation of the test of astronomy standards (TOAST). Journal of Astronomy & Earth Sciences Education, 1(1), 1-22. https://doi.org/10.19030/jaese.v1i1.9102 Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Pearson Education. Taşcan, M. (2019). Astronomi eğitimi üzerine geliştirilen fen etkinliklerinin 5. sınıf öğrencilerinin uzamsal becerileri ve akademik başarıları üzerine etkisi [Yayımlanmamış doktora tezi]. İnönü Üniversitesi. Tavşancıl, E. (2014). Tutumların ölçülmesi ve SPSS ile veri analizi (5. Baskı). Nobel Yayıncılık. Taylor, I., Barker, M., & Jones, A. (2003). Promoting mental model building in astronomy education. International Journal of Science Education, 25(10), 1205-1225. https://doi.org/10.1080/0950069022000017270a Trumper, R. (2000). University students' conceptions of basic astronomy concepts. Physics Education, 35(1), 9. https://doi.org/10.1088/0031-9120/35/1/301 Trumper, R. (2001a). A cross-age study of junior high school students' conceptions of basic astronomy concepts. International Journal of Science Education, 23(11), 1111-1123. https://doi.org/10.1080/09500690010025085 Trumper, R. (2001b). A cross-age study of senior high school students' conceptions of basic astronomy concepts. Research in Science & Technological Education, 19(1), 97-109. https://doi.org/10.1080/02635140120046259 Trumper, R. (2001c). A cross-college age study of science and nonscience students' conceptions of basic astronomy concepts in preservice training for high-school teachers. Journal of Science Education and Technology, 10(2), 189-195. https://doi.org/10.1023/A:1009477316035 Trumper, R. (2006). Teaching future teachers basic astronomy concepts—seasonal changes—at a time of reform in science education. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching, 43(9), 879-906. https://doi.org/10.1002/tea.20138 Turan, F., & Timur, B. (2023). Güneş sistemi konusuna yönelik beceri temelli başarı testi geliştirilmesi. SDU International Journal of Educational Studies, 10(2), 88-112. https://doi.org/10.33710/sduijes.1366550 Türk, C., & Kalkan, H. (2015). Developing an achievement test for astronomy education. Journal of Studies in Education, 5(3), 89-112. https://doi.org/10.5296/jse.v5i3.8099 Ünal, İ., & Taşcan, M. (2022). Kuramdan uygulamaya eğitimde astronomi. Palme Yayıncılık. Unat, Y. (2003). Astronomi. Felsefe Ansiklopedisi, 1, 637-639. Utari, G. P., Liliawati, W., & Utama, J. A. (2021). Design and validation of six-tier astronomy diagnostic test instruments with Rasch Model analysis. In Journal of Physics: Conference Series 1806(1), 012028). IOP Publishing. https://doi.org/10.1088/1742-6596/1806/1/012028 Varzikioğlu, D. (2023). Astronomi etkinlikleri ve eğitsel oyunlarla zenginleştirilmiş öğretimin astronomi başarısına ve tutumuna etkisi [Yayımlanmamış yüksek lisans tezi]. Gazi Üniversitesi. Williamson, K. E. (2013). Development and calibration of a concept inventory to measure introductory college astronomy and physics students' understanding of Newtonian gravity [Unpublished doctoral dissertation]. Montana State University. Yurtyapan, E., & Çilingiroğlu-Şekercioğlu, A. G. (2023). Development of an achievement test for the seasons and climate unit of the eighth-grade science course in secondary school. International Journal of Contemporary Educational Research, 10(4), 893-916. https://doi.org/10.52380/ijcer.2023.10.4.501 Zeilik, M. (2002). Birth of the astronomy diagnostic test: Prototest evolution. Astronomy Education Review, 1(2), 46-52. https://doi.org/10.3847/AER2002005