Spatial ability test for university students: Development, validity and reliability studies

Abstract

This study aimed to develop a useful test to measure university students’ spatial abilities validly and reliably. Following a sequential explanatory mixed methods research design, first, qualitative methods were used to develop the trial items for the test; next, the psychometric properties of the test were analyzed through quantitative methods using data obtained from 456 university students. As a result, a multiple-choice spatial ability test with 27 items and five options was created, divided into three subtests: spatial relations, spatial visualization, and spatial orientation. The results suggested that scores obtained from the spatial ability test and its subtests are valid and reliable.

Keywords

• Student evaluation
• Test development
• Spatial ability

References

1. Abdi, H. (2010). Holm's sequential Bonferroni procedure. In N. Salkind (Eds.), Encyclopedia of research design (pp. 1-8). Sage Publication.
2. Bakker, M. (2008). Spatial ability in primary school: Effects of the Tridio® learning material [Master's thesis]. University of Twente.
3. Bandalos, D.L. (2018). Measurement theory and applications for the social sciences (1st ed.). Guilford Publications.
4. Battista, M.T., Wheatley, G.H., & Talsma, G. (1982). The importance of spatial visualization and cognitive development for geometry learning in preservice elementary teachers. Journal for Research in Mathematics Education, 13(5), 332 340. https://doi.org/10.5951/jresematheduc.13.5.0332
5. Barnea, N. (2000). Teaching and Learning about Chemistry and Modelling with a Computer managed Modelling System. In Gilbert J.K., Boulter C.J. (Eds.), Developing Models in Science Education (pp. 307-323). Springer. https://doi.org/10.1007/978-94-010-0876-1_16
6. Brooks, G.P., & Johanson, G.A. (2003). TAP: Test Analysis Program. Applied Psychological Measurement, 27(4), 303-304. https://doi.org/10.1177/0146621603027004007
7. Brown, T. A. (2006). Confirmatory factor analysis for applied research (1st ed.). The Guilford Press.
8. Burnett, S.A., & Lane, D.M. (1980). Effects of academic instruction on spatial visualization. Intelligence, 4(3), 233-242. https://doi.org/10.1016/0160-2896(80)90021-5

9. Cameron, A. (2004). Kurtosis. In M. Lewis-Beck, A. Bryman and T. Liao (Eds.). Encyclopedia of social science research methods (pp. 544-545). SAGE Publications, Inc.
10. Campos, A., & Campos-Juanatey, D. (2020). Measure of spatial orientation ability. Imagination, Cognition and Personality, 39(4), 348 357. https://doi.org/10.1177/0276236619896268
11. Carroll, J.B. (1993). Human cognitive abilities: A survey of factor-analytic studies (No. 1). Cambridge University Press.
12. Clements, D.H. (1998). Geometric and spatial thinking in young children. National Science Foundation.
13. Clements, D.H., & Battista, M.T. (1992). Geometry and spatial reasoning. In D.A. Grouws (Eds.), Handbook of research on mathematics teaching and learning (pp. 420-464). Macmillan.
14. Contero, M., Naya, F., Company, P., Saorín, J.L., & Conesa, J. (2005). Improving visualization skills in engineering education. IEEE Computer Graphics and Applications, 25(5), 24-31. https://doi.org/10.1109/MCG.2005.107
15. Contreras, M.J., Escrig, R., Prieto, G., & Elosúa, M.R. (2018). Spatial visualization ability improves with and without studying Technical Drawing. Cognitive processing, 19(3), 387-397. https://doi.org/10.1007/s10339-018-0859-4
16. Creswell, J.W., & Plano Clark, V.L. (2011) Designing and conducting mixed methods research (2nd ed.). Sage Publications.
17. Crocker, L., & Algina, J. (2008). Introduction to classical and modern test theory. Cengage Learning.
18. D'Oliveira, T.C. (2004). Dynamic spatial ability: An exploratory analysis and a confirmatory study. The International Journal of Aviation Psychology, 14(1), 19-38. https://doi.org/10.1207/s15327108ijap1401_2
19. Davis, L.L. (1992). Instrument review: getting the most from a panel of experts. Applied Nursing Research, 5, 194-197. https://doi.org/10.1016/S0897-1897(05)80008-4
20. Diederich, P.B. (1973). Short-cut statistics for teacher-made tests. Educational testing service. https://files.eric.ed.gov/fulltext/ED081785.pdf
21. Dokumacı Sütçü, N. (2021). Research tendencies towards spatial ability in Turkey. International Journal of Society Researches, 17(36), 2605 2636. https://doi.org/10.26466/opus.839496
22. Downing, S.M. (2006). Twelve steps for effective test development. In S.M. Downing & T.M. Haladyna (Eds.), Handbook of test development (pp. 3–26). Lawrence Erlbaum Associates.
23. Ebel, R.L., & Frisbie, D.A. (1991). Essentials of educational measurement (5th ed.). Prentice-Hall.
24. Ekstrom, R.B., French, J.W., Harman, H.H., & Dermen, D. (1976). Manual for kit of factor-referenced cognitive tests. Educational Testing Service.
25. Eliot, J., & Hauptman, A. (1981). Different dimensions of spatial ability. Studies in Science Education, 8(1), 45-66. https://doi.org/10.1080/03057268108559886
26. Gardner, H. (1983). Frames of mind: The theory of multiple intelligences. Basic Books.
27. Gilligan, K.A., Flouri, E., & Farran, E.K. (2017). The contribution of spatial ability to mathematics achievement in middle childhood. Journal of experimental child psychology, 163, 107-125. https://doi.org/10.1016/j.jecp.2017.04.016
28. Gronlund, N.E. (1977). Constructing achievement tests (2nd ed.). Prentice-Hall.
29. Guay, R.B. (1977). Purdue spatial visualization test. Purdue Research Foundation.
30. Guilford, J.P., Fruchter, B., & Zimmerman, W.S. (1952). Factor analysis of the army air forces sheppard field battery of experimental aptitude tests. Psychometrika, 17(1), 45–68. https://doi.org/10.1007/BF02288795
31. Guilford, J.P., & Zimmerman, W.S. (1948). The Guilford-Zimmerman Aptitude Survey. Journal of applied Psychology, 32(1), 24-34. https://doi.org/10.1037/h0063610
32. Hair, J.F., Jr., Black, W.C., Babin, B.J., Anderson, R.E., & Tatham, R.L. (2014). Multivariate data analysis (7th ed.). Pearson New International Edition.
33. Hambleton, R.K., & Jirka, S.J. (2006). Anchor-based methods for judgmentally estimating item statistics. In Downing, S.M., & Haladyna, T.M. (Eds.). Handbook of test development (pp. 399-420). Lawrence Erlbaum Associates Publishers.
34. Hegarty, M., & Waller, D. (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32(2), 175 191. https://doi.org/10.1016/j.intell.2003.12.001
35. Hingorjo, M.R., & Jaleel, F. (2012). Analysis of one-best MCQs: the difficulty index, discrimination index and distractor efficiency. JPMA-Journal of the Pakistan Medical Association, 62(2), 142-147. https://www.jpma.org.pk/PdfDownload/3255
36. Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
37. Irwing, P., Booth, T., & Hughes, D.J. (2018). The Wiley handbook of psychometric testing. A Multidisciplinary Reference on Survey, Scale and Test Development. Wiley-Blackwell.
38. İpekoğlu, A., Kepceoğlu, İ. & Biber, A.Ç. (2020). Thematic and methodological trends of graduate theses related to spatial ability: the case of Turkey. International Journal of Contemporary Educational Studies, 6(2), 681 699. https://dergipark.org.tr/en/pub/intjces/issue/59193/829670
39. Jöreskog, K.G. & Sörbom, D. (1993). LISREL 8: Structural Equations Modeling with the SIMPLES Command Language. Scientific Software, International.
40. Jöreskog, K.G. & Sörbom, D. (1996). Lisrell 8 reference guide. Scientific Software International.
41. Kell, H.J., Lubinski, D., Benbow, C.P., & Steiger, J.H. (2013). Creativity and technical innovation: Spatial ability’s unique role. Psychological Science, 24(9), 1831-1836. https://doi.org/10.1177/0956797613478615
42. Kerkman, D.D., Wise, J.C., & Harwood, E.A. (2000). Impossible “mental rotation” problems: A mismeasure of women's spatial abilities?. Learning and Individual Differences, 12(3), 253-269. https://doi.org/10.1016/S1041-6080(01)00039-5
43. Kim, J., & Irizarry, J. (2021). Evaluating the use of augmented reality technology to improve construction management student’s spatial skills. International Journal of Construction Education and Research, 17(2), 99 116. https://doi.org/10.1080/15578771.2020.1717680
44. Kline, R.B. (2011). Principles and practice of structural equation modeling. Guilford Press.
45. Kozhevnikov, M., & Hegarty, M. (2001). A dissociation between object manipulation spatial ability and spatial orientation ability. Memory & Cognition, 29(5), 745-756. https://doi.org/10.3758/BF03200477
46. Likert, R., & Quasha, W.H. (1941). Revised Minnesota Paper Form Board. Psychological Corporation.
47. Linn, M., & Petersen, A.C. (1985). Emergence and characterization of sex differences in spatial ability: A meta analysis. Child Development, 56(6), 1479 1498. https://www.jstor.org/stable/1130467
48. Livingston, S.A. (2006). Item Analysis. In Downing, S. M., & Haladyna, T. M. (Eds.). Handbook of test development (pp. 421-441). Lawrence Erlbaum Associates Publishers.
49. Lohman, D.F. (1979). Spatial ability: A review and reanalysis of the correlational literature. Technical Report. No. 8, Stanford University. https://apps.dtic.mil/sti/pdfs/ADA075972.pdf
50. Lohman, D.F. (1993, July 8). Spatial ability and g. Paper presented at the first Spearman Seminar, University of Plymouth, England. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.111.7385&rep=rep1&type=pdf
51. Lord, T.R. (1985). Enhancing the visuo‐spatial aptitude of students. Journal of research in science teaching, 22(5), 395-405. https://doi.org/10.1002/tea.3660220503
52. Maier, P.H. (1996, March). Spatial geometry and spatial ability–How to make solid geometry solid. In Selected papers from the Annual Conference of Didactics of Mathematics (pp. 69-81). http://webdoc.sub.gwdg.de/ebook/e/gdm/1996/maier.pdf
53. Martín‐Dorta, N., Saorín, J.L., & Contero, M. (2008). Development of a fast remedial course to improve the spatial abilities of engineering students. Journal of Engineering Education, 97(4), 505-513. https://doi.org/10.1002/j.2168-9830.2008.tb00996.x
54. McGee, M.G. (1979). Human spatial abilities: Psychometric studies and environmental, genetic, hormonal, and neurological influences. Psychological Bulletin, 86(5), 889–918. https://doi.org/10.1037/0033-2909.86.5.889
55. Mohler, J.L. (2008). Examining the spatial ability phenomenon from the student's perspective. The Engineering Design Graphics Journal, 72(3), 1 15. http://gpejournal.org/index.php/EDGJ/article/view/50
56. National Research Council (NRC) (2006). Learning to think spatially. National Academies Press.
57. Olkun, S. (2003). Making connections: Improving spatial abilities with engineering drawing activities. International Journal of Mathematics Teaching and Learning, 3(1), 1-10. http://www.ex.ac.uk/cimt/ijmtl/ijabout.htm
58. Olkun, S., Smith, G.G., Gerretson, H., Yuan, Y., & Joutsenlahti, J. (2009). Comparing and enhancing spatial skills of pre-service elementary school teachers in Finland, Taiwan, USA, and Turkey. Procedia-Social and Behavioral Sciences, 1(1), 1545-1548. https://doi.org/10.1016/j.sbspro.2009.01.271
59. Ozcakir Sumen, O. (2019). A meta-synthesis about the studies on spatial skills in Turkey. International Online Journal of Educational Sciences, 11(4), 23-41. https://doi.org/10.15345/iojes.2019.04.003
60. Patkin, D., & Dayan, E. (2013). The intelligence of observation: improving high school students’ spatial ability by means of intervention unit. International Journal of Mathematical Education in Science and Technology, 44(2), 179-195. https://doi.org/10.1080/0020739X.2012.703335
61. Pellegrino, J.W., Alderton, D.L., & Shute, V.J. (1984). Understanding spatial ability. Educational psychologist, 19(4), 239 253. https://doi.org/10.1080/00461528409529300
62. Pellegrino, J.W., & Kail, R.V. (1982). Process analyses of spatial aptitude. In R. J. Sternberg (Eds.), Advances in the psychology of human intelligence (Vol. I, pp. 311-365). Lawrence Erlbaum Associates.
63. Sarama, J., & Clements, D. (2009). Early childhood mathematics education research: Learning trajectories for young children. Routledge.
64. Sevimli, E. (2009). Consideration of pre-services mathematics teachers’ preferences of representation in terms of definite integral within the context of certain spatial abilities and academic achievement [Master's thesis]. University of Marmara, Turkey.
65. Shepard, R.N., & Metzler, J. (1971). Mental rotation of three-dimensional objects. Science, 171(3972), 701-703. https://doi.org/10.1126/science.171.3972.701
66. Sisman, B., Kucuk, S., & Yaman, Y. (2021). The effects of robotics training on children’s spatial ability and attitude toward STEM. International Journal of Social Robotics, 13(2), 379-389. https://doi.org/10.1007/s12369-020-00646-9
67. Sorby, S.A., & Baartmans, B.J. (2000). The development and assessment of a course for enhancing the 3‐D spatial visualization skills of first year engineering students. Journal of Engineering Education, 89(3), 301 307. https://doi.org/10.1002/j.2168 9830.2000.tb00529.x
68. Tabachnick, B.G., & Fidell, L.S. (2013). Using multivariate statistics (6th ed.). Pearson.
69. Tartre, L.A. (1990). Spatial orientation skill and mathematical problem solving. Journal for research in Mathematics Education, 21(3), 216 229. https://doi.org/10.5951/jresematheduc.21.3.0216
70. Thurstone, L.L., & Thurstone, T.G. (1941). The Chicago tests of primary mental abilities. The American Council on Education.
71. Turgut, M., & Nagy-Kondor, R. (2013). Spatial visualization skills of Hungarian and Turkish prospective mathematics teachers. International Journal for Studies in Mathematics Education, 6(1), 168-183. https://doi.org/10.17921/2176-5634.2013v6n1p%25p
72. Wells, C.S., & Wollack, J.A. (2003). An instructor’s guide to understanding test reliability. Testing and Evaluation Services, University of Wisconsin.
73. Wendler, C.L., & Walker, M.E. (2006). Practical issues in designing and maintaining multiple test forms for large-scale programs. In Downing, S.M., & Haladyna, T.M. (Eds.), Handbook of test development (pp. 445-467). Lawrence Erlbaum Associates Publishers.
74. Winter, J.W., Lappan, G., Fitzgerald, W., & Shroyer, J. (1989). Middle Grades Mathematics Project: Spatial Visualization. Addison-Wesley.
75. Witkin, H.A. (1950). Individual differences in ease of perception of embedded figures. Journal of Personality, 19, 1-15. https://doi.org/10.1111/j.1467-6494.1950.tb01084.x
76. Young, C.J., Levine, S.C., & Mix, K.S. (2018). The connection between spatial and mathematical ability across development. Frontiers in psychology, 9(1), 1-7. https://doi.org/10.3389/fpsyg. 2018.00755