Development of an achievement test on the eighth-grade “acids and bases” topic

Year 2025, Volume: 9 Issue: 4, 300 - 321, 23.12.2025

Özgür Barutçu , Çiğdem Şahin Çakır

https://doi.org/10.34056/aujef.1656071

Abstract

This study aimed to develop an achievement test specifically for eighth-grade middle school students on the topic of 'Acids and Bases' (ABAT). The research process followed standard test development procedures, focusing on creating a practical achievement test. The sample included 282 eighth-grade students from various middle schools. Data were analyzed using SPSS 27.00, Factor 11.02.04 software, and Microsoft Excel. Both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were conducted using the Factor 11.02.04 program. The EFA revealed a two-factor structure with 24 items, a KMO value of 0.82, and explained 40% of the total variance. The CFA confirmed the two-factor model for the ABAT. Additionally, the independent-samples t-test supported the construct validity of the ABAT, demonstrating its ability to distinguish between lower and higher groups. The difficulty and discrimination indices of the ABAT were moderate, and the KR-20 reliability coefficient was 0.87. Overall, this study developed a reliable and valid assessment tool that educators and researchers can use to evaluate middle school students' achievement in 'Acids and Bases' or to identify learning gaps.

Keywords

Achievement test , Acids and bases , Development test

Ethical Statement

This study was conducted with the approval decision taken at the meeting of Giresun University Social Sciences Science and Engineering Sciences Research Ethics Committee (Number: E-50288587-050.01.04-138010) dated January 11, 2023 and numbered 01/28.

Supporting Institution

no

Thanks

This study was produced from the master's thesis research conducted by Özgür BARUTÇU under the supervision of Prof. Dr. Çiğdem ŞAHİN ÇAKIR. We would like to thank Associate Professor Dr. Hava IPEK AKBULUT from Trabzon University Fatih Faculty of Education, Professor Dr. Fatma YAMAN from Bozok University Faculty of Education, and Professor Dr. Fethiye Karslı BAYDERE from Giresun University Faculty of Education for their contributions to the development of the ABAT.

References

• Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education, 9(1), 109-119. http://doi.org/10.11591/ijere.v9i1.20457
• Aydın, T., & Faydaoğlu, Ş. (2022). Çember başarı testi geçerlik ve güvenirlik araştırması [Investigation of the validity and reliability of circle success test]. International Journal of New Trends in Arts, Sports & Science Education (IJTASE), 11(4), 217-226. https://www.ijtase.net/index.php/php/article/view/30/30.
• Aydın Gürler, S., & Akgün, H. (2023). 4. sınıf fen bilimleri dersi "maddenin özellikleri" ünitesine ilişkin akademik başarı testi geliştirme: Geçerlik ve güvenirlik çalışması [4th grade science course "properties of matter" unit related academic achievement test development: Validity and reliability study]. Electronic Journal of Social Sciences, 22(88), 1849- 1870. https://doi.org/10.17755/esosder.1299406
• Ayvacı, D. H. Ş., & Durmuş, A. (2016). Bir başarı testi geliştirme çalışması: ısı ve sıcaklık başarı testi geçerlik ve güvenirlik araştırması [An achievement test development study: heat and temperature achievement test validity and reliability research]. Ondokuz Mayıs University Journal of Education Faculty, 35(1), 87-103. https://dergipark.org.tr/tr/pub/omuefd/issue/26353/277708.
• Baybutoğlu, G. M. (2011). İlköğretim öğrencilerinin fen ve teknoloji dersi asitler-bazlar konusundaki kavramsal anlama düzeylerinin incelenmesi [The investigation of elementary students’ conceptual understanding levels of acids-bases in science and technology education]. (Publication No. 286512) [Master’s Thesis, Dokuz Eylul University]. Council of Higher Education Thesis Center.
• Bolat, A., & Karamustafaoğlu, S. (2019). Vücudumuzdaki sistemler ünitesi başarı testi geliştirme: Geçerlik ve güvenirlik [Development achievement of test on the unit “systems in our body”: Validity and reability]. Gazi Journal of Educational Science, 5(2), 131-159. https://dergipark.org.tr/en/pub/gebd/issue/47331/559587.
• Boz, C., Sarıoğlan, A. B., & Özcan, H. (2022). Kimyasal bağlar konusunda başarı testi geliştirme çalışması [Development of an achievement test on chemical bonds]. Manisa Celal Bayar University Journal of The Faculty of Education, 10(2), 149-166. https://doi.org/10.52826/mcbuefd.1065432
• Bradley, J. D. & Mosimege, M. D. (1998). Misconceptions in acids and bases: a comparative study of student teachers with different chemistry backgrounds. South African Journal of Chemistry, 51(3), 137-145. https://journals.co.za/doi/pdf/10.10520/AJA03794350_1436.
• Büyüköztürk, Ş. (2012). Sosyal bilimler için veri analizi el kitabı istatistik, araştırma deseni SPSS uygulamaları ve yorum [Data analysis handbook for social sciences: statistics, research design, SPSS applications and interpretation]. (16th Edition). Ankara: Pegem.
• Can, A. (2017). SPSS ile bilimsel araştırma sürecinde nicel veri analizi [Quantitative data analysis in scientific research process with SPSS] (5th Edition). Pegem.
• Canbazoğlu Bilici, S. (2019). Örnekleme yöntemleri [Sampling methods]. H. Özmen ve O. Karamustafaoğlu (Ed.), Eğitimde Araştırma Yöntemleri [Research Methods in Education] (p.56-78). Pegem.
• Cetin-Dindar, A., & Geban, O. (2017). Conceptual understanding of acids and bases concepts and motivation to learn chemistry. The Journal of Educational Research, 110(1), 85-97. https://doi.org/10.1080/00220671.2015.1039422
• Chang, C., Yeh, T., & Barufaldi, J. P. (2009). The positive and negative effects of science concept tests on student conceptual understanding. International Journal of Science Education, 32(2), 265–282. https://doi.org/10.1080/09500690802650055
• Chiu, M. (2007). A national survey of students’ conceptions of chemistry in Taiwan. International Journal of Science Education, 29(4), 421–452. https://doi.org/10.1080/09500690601072964
• Çökelez, A. (2010). A comparative study of French and Turkish students' ideas on acid-base reactions. Journal of Chemical Education, 87(1), 102-106. https://doi.org/10.1021/ed800017b.
• Dağ, M., & Karamustafaoğlu, S. (2023). “Maddenin özellikleri” ünitesi: başarı testi geliştirme ve öğrenci başarısını belirleme [“Properties of matter” unit: Success test development and determining student success]. Milli Egitim journal, 52(237), 221-254. https://doi.org/10.37669/milliegitim.1076053
• Demir, N., Kızılay, E., & Bektaş, O. (2016). 7. sınıf çözeltiler konusunda başarı testi geliştirme: Geçerlik ve güvenirlik çalışması [Development of an achievement test about solutions for 7th graders: a validity and reliability study]. Necatibey Faculty of Education Electronic Journal of Science and Mathematics Education, 10(1). https://doi.org/10.17522/nefefmed.52947
• Demircioglu, G., Ayas, A., & Demircioglu, H. (2005). Conceptual change achieved through a new teaching program on acids and bases. Chemistry Education Research and Practice, 6(1), 36-51. https://doi.org/10.1039/B4RP90003K
• Demircioglu, G., Ozmen, H., & Ayas, A. (2004). Some concepts misconceptions encountered in chemistry: A research on acid and base. Educational Sciences: Theory & Practice, 4(1), 73-80. https://openurl.ebsco.com/results?sid=ebsco:ocu:record&bquery=IS+2630-5984+AND+VI+4+AND+IP+1+AND+DT+2004&link_origin=scholar.google.com&searchDescription=Educational%20Sciences%3A%20Theory%20%26%20Practice%2C%202004%2C%20Vol%204%2C%20Issue%201.
• Divarcı, Ö. F., & Kaya, H. (2019). 8. sınıf “Maddenin Halleri ve Isı” ünitesine yönelik geçerliliği ve güvenirliği sağlanmış bir akademik başarı testi geliştirme çalışması [A study of developing an achievement test which has reliability and validity on “states of matter and heat” unit for 8th grade]. The Journal of Education, Theory and Practical Research (JETPR), 5(2), 214-238. https://dergipark.org.tr/en/pub/ekuad/issue/47044/591531.
• Edwards, A. D., & Head, M. (2016). Introducing a culture of modeling to enhance conceptual understanding in high school chemistry courses. Journal of Chemical Education, 93(8), 1377-1382. https://doi.org/10.1021/acs.jchemed.6b00125.
• Elham, H., Dilmaghani, K. A. & Hesar, A.P. (2019). Students’ misconceptions on acid-base chemistry. Basic Education College Magazine for Educational and Humanities Sciences, 43, 743-753. https://iasj.rdd.edu.iq/journals/uploads/2024/12/27/442d1e776e4e8e284a2f84df399c3751.pdf.
• Eren, A. A., Önal, N. T., & Büyük, U. (2020). Elementler ve bileşikler konusu için geçerli ve güvenilir bir başarı testi geliştirme çalışması [Valid and reliable achievement test development study about element and compounds]. Pearson Journal of Social Sciences & Humanities, 5(6), 152-167. https://doi.org/10.46872/pj.52
• Eyceyurt Türk, G., & Güngör Seyhan, H. (2022). Asit-baz kavramları ile ilgili üniversite öğrencilerinin kavram önermelerinin, kavram imajlarının ve kavram yanılgılarının belirlenmesi: Türkiye ve İspanya karşılaştırmalı örnekleri ile [Determining the concept definitions, concept images and misconceptions of university students related to acid-base concepts: with comparative examples of Türkiye and Spain]. Sivas Cumhuriyet University Educational Sciences Institute Journal, 1(2), 98-107. https://dergipark.org.tr/tr/pub/cebed/issue/73073/1131571.
• Feng, S. L. & Tuan, L.H. (2005). Using arcs model to promote 11th graders’ motivation and achievement in learning about acids and bases. International Journal of Science and Mathematics Education, 3(3), 463-484. https://doi.org/10.1007/s10763-004-6828-7
• Göncü, Ö. (2013). İlköğretim beşinci ve yedinci sınıf öğrencilerinin astronomi konularındaki kavram yanılgılarının tespiti (Determining of astronomical misconception in fifth and seventh grade students). (Publication No. 358141) [Master’s Thesis, Mehmet Akif Ersoy University]. Council of Higher Education Thesis Center.
• Hasançebi, B., Terzi, Y., & Küçük, Z. (2020). Madde güçlük indeksi ve madde ayırt edicilik indeksine dayalı çeldiriciler [Distractor analysis based on item difficulty index and item discrimination index]. Gümüşhane University Journal of Science and Technology, 10(1), 224-240. https://doi.org/10.17714/gumusfenbil.615465.
• Haslam, F. & Treagust, D. F. (1987). Diagnosing secondary students' misconceptions of photosynthesis and respiration in plants using a two-tier multiple-choice instrument. Journal of Biological Education, 21(3), 203-211. https://doi.org/10.1080/00219266.1987.9654897
• Holme, T. A., Luxford, C. J., & Brandriet, A. (2015). Defining conceptual understanding in general chemistry. Journal of Chemical Education, 92(9), 1477-1483. https://doi.org/10.1021/acs.jchemed.5b00218.
• Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53-60. https://academic-publishing.org/index.php/ejbrm/article/view/1224/1187.
• Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
• Kaplan, E., Bektas, O., & Karaca, M. (2022). Madde ve ısı ünitesi başarı testi geliştirme çalışması [Development of an achievement test about matter and heat unit]. Mehmet Akif Ersoy University Journal of Education Faculty, (63), 78-116. https://doi.org/10.21764/maeuefd.985968
• Karslı, F. & Ayas, A. (2013). Fen bilgisi öğretmen adaylarının kimya konularında sahip oldukları alternatif kavramlar [Prospective science teachers’ alternative conceptions about the chemistry issues]. Necatibey Faculty of Education Electronic Journal of Science and Mathematics Education, 7(2), 284-313. https://doi.org/10.12973/nefmed211.
• Kline, R. (2013). Exploratory and confirmatory factor analysis. Petscher, Y., Schatschneider, C. & Compton, D.L. (Eds), Applied quantitative analysis in education and the social sciences (171-207) inside. https://doi.org/10.4324/9780203108550
• Köroğlu, M. N., Karaca, M., & Bektas, O. (2023). Maddenin yapısı ve özellikleri konusunda başarı testi geliştirme: geçerlik ve güvenirlik çalışması [Developing an achievement test on the structure and properties of the substance: A validity and reliability study]. Anadolu University Journal of Education Faculty, 7(1), 1-32. https://doi.org/10.34056/aujef.997764.
• McClary, L. M., & Bretz, S. L. (2012). Development and assessment of a diagnostic tool to identify organic chemistry students’ alternative conceptions related to acid strength. International Journal of Science Education, 34(15), 2317– 2341. https://doi.org/10.1080/09500693.2012.684433
• McClary, L., & Talanquer, V. (2011). College chemistry students' mental models of acids and acid strength. Journal of Research in Science Teaching, 48(4), 396-413. https://doi.org/10.1002/tea.20407
• Ministry of National Education. (2018). Fen bilimleri dersi öğretim programı (İlkokul ve ortaokul 3, 4, 5, 6, 7 ve 8. sınıflar) [Science course curriculum (Primary and secondary school 3rd, 4th, 5th, 6th, 7th and 8th grades)]. https://mufredat.meb.gov.tr
• Nacaroğlu, O., Bektaş, O., & Kızkapan, O. (2020). Madde döngüleri ve çevre sorunları konusunda başarı testi geliştirme: Geçerlik ve güvenirlik çalışması [Developing an achievement test for matter cycles and environmental problems: a validity and reliability study]. Kastamonu Education Journal, 28(1), 36-51. https://doi.org/10.24106/kefdergi.3374
• Nakhleh, M. B. (1992). Why some students don't learn chemistry: Chemical misconceptions. Journal of Chemical Education, 69(3), 191-196. https://doi.org/10.1021/ed069p191
• Orduhan, Y. & Şahin Çakır, Ç. (2023). Ortaokul 6. Sınıf “ses ve özellikleri” ünitesine yönelik kavramsal anlama testi geliştirme çalışması [Middle school 6th grade conceptual understanding test development study for “sound and its characteristics” unit]. International Journal of Education Science and Technology, 9(3), 138-178. https://doi.org/10.47714/uebt.1355916
• Özcan, H., Çetinkaya, İ., & Arık, S. (2021). Ortaokul öğrencilerinin basit makineler ünitesi ile ilgili anlayışlarını ölçmeye yönelik bir test geliştirme çalışması [Development of an instrument for measuring secondary school students' understanding of simple machines unit]. MSKU Journal of Education, 8(1), 16-36. https://doi.org/10.21666/muefd.742102
• Özkan, S. & Yadigaroğlu, M. (2020). Başarı testi geliştirme: Asit-baz başarı testi geçerlik ve güvenirlik araştırması [Development of achievement test: a validity and reliability research for acid-base achievement test]. Turkish Studies- Education, 15(2), 1141-1163. https://dx.doi.org/10.29228/TurkishStudies.41734
• Özkılıç, G. E., Bektas, O., & Karaca, M. (2023). Sindirim sistemi ünitesine yönelik başarı testi geliştirme: Geçerlik ve güvenirlik çalışması [Development of an achievement test for the digestive system unit: a validity and reliability study]. Research and Experience Journal (REJ), 8(1), 115-154. https://doi.org/10.47214/adeder.1267535
• Pabuçcu, A., & Geban, Ö. (2015). 5e öğrenme döngüsüne göre düzenlenmiş uygulamaların asit-baz konusundaki kavram yanılgılarına etkisi [Effects of 5e learning cycle instruction on misconceptions on acid-base concepts]. Bolu Abant İzzet Baysal University Journal of Faculty of Education, 15(1), 191-206. https://doi.org/10.17240/aibuefd.2015.15.1-5000128602
• Pazar, B., & Karamustafaoğlu, S. (2023). “Saf Madde ve Karışımlar” ünitesi başarı testi geliştirme: geçerlik ve güvenirlik [“Pure substances and mixtures” unit achievement test development: validity and reliability]. Anadolu University Journal of Education Faculty, 7(2), 404-432. https://doi.org/10.34056/aujef.1021291
• Peterson, R.F., Treagust, D.F. & Garnett, P.J. (1989). Development and application of a diagnostic instrument to evaluate grade-11 and -12 students’ concepts of covalent bonding and structure following a course of instruction. Journal of Research in Science Teaching, 26(4), 301-314. https://doi.org/10.1002/tea.3660260404
• Ross, B., & Munby, H. (1991). Concept mapping and misconceptions: A study of high-school students' understandings of acids and bases. International Journal of Science Education, 13(1), 11–23. https://doi.org/10.1080/0950069910130102
• Sheppard, K. (2006). High school students’ understanding of titrations and related acid-base phenomena. Chemistry Education Research and Practice, 7(1), 32-45. https://doi.org/10.1039/B5RP90014J
• Smith, K. J., & Metz, P. A. (1996). Evaluating student understanding of solution chemistry through microscopic representations. Journal of Chemical Education, 73(3), 233-235. https://doi.org/10.1021/ed073p233
• Sontay, G. & Karamustafaoğlu, O. (2020). Fen bilimleri dersi “Güneş, Dünya ve Ay” ünitesine yönelik başarı testinin geliştirilmesi [Developing achievement test for science course’s “Sun, Earth and Moon” unit]. Journal of Gazi Faculty of Education, 40(2), 511-551. Retrieved from https://dergipark.org.tr/tr/pub/gefad/issue/56462/670701.
• Sontay, G., & Karamustafaoğlu, S. (2017). 5. sınıf fen bilimleri dersi “yer kabuğunun gizemi” ünitesine yönelik başarı testi geliştirme [Development of an achievement test for the 5th grade science course unit "The Mystery of the Earth's Crust]. Fen Bilimleri Öğretimi Dergisi, 5(1), 62-86. https://dergipark.org.tr/tr/pub/fbod/issue/71987/1157996.
• Şahin, Ç., & Çepni, S. (2011). Development of a two-tiered test for determining differentiation in conceptual structure related to “Floating-sinking, buoyancy and pressure” concepts. Journal of Turkish Science Education, 8(1), 79-110. https://www.tused.org/index.php/tused/article/view/548.
• Tsui, C., & Treagust, D. (2009). Evaluating secondary students’ scientific reasoning in genetics using a two‐tier diagnostic instrument. International Journal of Science Education, 32(8), 1073–1098. https://doi.org/10.1080/09500690902951429
• Tüncaz, M. & Şahin Çakır, Ç. (2024). Ortaokul beşinci sınıf “Güneş, Dünya ve Ay” ünitesine yönelik iki aşamalı kavram testi geliştirilmesi [Developing a two-stage concept test for the "Sun, Earth, and Moon" unit in the fifth grade of secondary school]. Electronic Journal of Social Sciences, 8(14), 88-117. https://doi.org/10.5281/zenodo.12635222
• Uçar, R. & Aktamış, H., (2019). Astronomi’ye yönelik tutum ölçeği ve 7. sınıf “Güneş Sistemi ve Ötesi” ünitesine yönelik başarı testi geliştirme çalışması [The study of developing the 7th class “solar system and beyond” unit achievement test and the astronomy attitude scale]. The Western Anatolia Journal of Educational Sciences (WAJES), 10(1), 57-78. https://dergipark.org.tr/en/download/article-file/743809.
• Uyanık, G. (2019). İlkokul öğrencilerinin fen bilimleri kavramlarına ilişkin kavram yanılgılarının belirlenmesi [Determination of the misconceptions towards science concepts of primary school students]. Turkish Science Research Foundation (TÜBAV), 12(4), 45-54. https://dergipark.org.tr/tr/download/article-file/927251.
• Üce, M., & Ceyhan, İ. (2019). Misconception in chemistry education and practices to eliminate them: Literature analysis. Journal of Education and Training Studies, 7(3), 202-208. https://doi.org/10.11114/jets.v7i3.3990
• Ültay, N., & Çalik, M. (2016). A comparison of different teaching designs of ‘Acids and Bases’ subject. Eurasia Journal of Mathematics, Science & Technology Education, 12(1), 57-86. https://doi.org/10.12973/eurasia.2016.1422a.
• Wandersee, J.H., Mintzes, J.J. & Novak, J.D. (1994). Research on alternative conceptions in science. In D.L.Gabel (Eds.), Handbook of research on science teaching and learning (177-210). Macmillan.
• Weizmann-Henelius, G., Putkonen, H., Grönroos, M., Lindberg, N., Eronen, M. & Häkkänen-Nyholm, H. (2010). Examination of psychopathy in female homicide offenders—Confirmatory factor analysis of the PCL-R. International Journal of Law and Psychiatry, 33(3), 177-183. https://doi.org/10.1016/j.ijlp.2010.03.008
• Yaşa, N. & Koçak, N. (2022). Asit- baz konusunda karşılaşılan kavram yanılgıları: Bir içerik analizi [Misconception on Acid-Base Concept: A Content Analysis]. Journal of Ahmet Kelesoglu Education Faculty, 4(1), 1-24. https://dergipark.org.tr/en/download/article-file/2335825.
• Zoller, U. (1990). Students’ misunderstandings and misconceptions in college freshman chemistry (General and organic). Journal of Research in Science Teaching, 27(10), 1053-1065. https://doi.org/10.1002/tea.3660271011.