AN ANALYSIS OF THE LONGITUDINAL MEASUREMENT INVARIANCE OF THE SOCIAL PRESENCE SCALE DEVELOPED FOR OPEN AND DISTANCE LEARNING ENVIRONMENTS
Abstract
As with all fields of social sciences, open and distance learning studies frequently use self-reports in their collection of data. Similarly, as with all measurement tools, proof of construct validity through statistical processes is important for testing hypotheses based on the findings, making decisions, and essentially ensuring the tools and methods used are fit for purpose. During construct validity testing processes, the reporting of findings regarding measurement invariance of a scale is an important element that is often neglected. This study aims to portray the longitudinal invariance of the Social Presence Scale (Cakmak, Cebi & Kan, 2014), which is frequently used to determine the social presence in open and distance learning environments research and has confirmed construct validity in the literature, through repeated measurements obtained in an experimental study. This research was conducted on 280 learners in a 3-month interval. The data gathered was analyzed for measurement invariance using the Mplus 7.0 software package in accordance with the four stages described in the literature. The measurement invariance tested in each stage were studied for ΔCFI, and ΔRMSEA values in addition to likelihood chi-square. The findings indicate the conditions required for measurement invariance in each stage, or in other words, the longitudinal invariance of the scale was achieved. The findings of this study may provide a precedent for similar studies in the future.
Keywords
Measurement invariance, longitudinal data, confirmatory factor analysis, open and distance learning, social presence
References
- Akcaoglu, M., & Lee, E. (2016). Increasing social presence in online learning through small group discussions. The International Review of Research in Open and Distributed Learning, 17(3). Doi: 10.19173/irrodl.v17i3.2293
- Annand, D. (2011). Social presence within the community of inquiry framework. The International Review of Research in Open and Distributed Learning, 12(5), 40-56. Doi: 10.19173/irrodl.v12i5.924
- Basusta, N.B.U. (2010). Olcme esdegerligi. Egitimde ve Psikolojide Olcme ve Degerlendirme Dergisi, 1(2), 58-64.
- Bentler, P.M., & Bonnet, D.C. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606.
- Borup, J., West, R. E., & Graham, C. R. (2012). Improving online social presence through asynchronous video. The Internet and Higher Education, 15(3), 195–203. Doi: 10.1016/j.iheduc.2011.11.001
- Boston, W., Diaz, S. R., Gibson, A. M., Ice, P., Richardson, J., & Swan, K. (2009). An exploration of the relationship between indicators of the community of inquiry framework and retention in online programs. Journal of Asynchronous Learning Networks, 13(3).
- Cakmak, E. K., Cebi, A., & Kan, A. (2014). E-ogrenme ortamlarina yonelik “sosyal bulunusluk olcegi” gelistirme calismasi. Kuram ve Uygulamada Egitim Bilimleri, 14(2), 755-768. Doi: 10.12738/estp.2014.2.1847
- Chen F.F., Sousa K.H. & West SG. (2005). Testing measurement invariance of second-order factor models. Structural Equation Modeling, 14, 471–492. Doi: 10.1207/s15328007sem1203_7
- Cheung, G. W., & Rensvold, R. B. (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. Doi: 10.1207/S15328007SEM0902_5
- Cheung, G.W., & Rensvold R.B. (1999). Testing factorial invariance across groups: A reconceptualization and proposed new method. Journal of Management, 25, 1–27.