PREDICTORS OF VOCATIONAL COLLEGE STUDENTS’ BEHAVIORAL INTENTION TO USE WEB-BASED LISTENING TEST

Abstract

As technological advancements are booming these days, there is an increasing interest in the use of web technologies within testing applications that support teaching and learning processes in all educational domains. One of the factors that is believed to influence such applications is learners’ behavioral intentions to use technology. This study has a purpose of examining the constructs that are directly or indirectly affecting participants’ behavioral intention to use listening exams delivered web-based in the 2015-2016 academic year in a ‘Foreign Language’ course with the participation of 929 students. The acceptance model related with computer based assessment was utilized to examine the predictors of participants’ behavioral intention. An online questionnaire was administrated to collect data and data were analyzed through linear regression analyses. The results of the research revealed that perceived usefulness was influenced by content of test, goal expectancy, perceived ease of use, and social influence. Additionally, facilitating conditions and computer self-efficacy significantly predicted perceived ease of use. Also, perceived playfulness was affected by content, goal expectancy and perceived usefulness. Finally, perceived ease of use, perceived usefulness, and perceived playfulness were found to induce direct effect on behavioral intention to use web-based listening test. As a result, web-based testing is expected to be utilized by participants if it is playful, useful, and ease to use and it is seen playful when it is useful.

Keywords

• online testing,web-based listening test,technology acceptance,behavioral intention,vocational college

MESLEK YÜKSEKOKULU ÖĞRENCİLERİNİN WEB TABANLI DİNLEME TESTİNİ KULLANMA NİYETLERİNİN YORDAYICILARI

Öz

Teknolojik gelişmelerde yaşanan artış sonucunda, tüm eğitim alanlarındaki öğretme ve öğrenme süreçlerini destekleyen test uygulamaları içinde web tabanlı teknolojilerin kullanılması konusuna ilgi gün geçtikçe artmaktadır. Bu tür uygulamaları etkilediğine inanılan faktörlerden biri, öğrencilerin teknolojiyi kullanma niyetleridir. Bu çalışma, 2015-2016 akademik yılında "Yabancı Dil" dersinde 929 öğrencinin katılımıyla yapılan web tabanlı dinleme sınavlarını ilişkin katılımcıların kullanma niyetlerini doğrudan veya dolaylı olarak etkileyen faktörleri incelemek amacıyla yapılmıştır. Bilgisayar Tabanlı Değerlendirme Kabul Modeli, katılımcıların kullanma niyetlerinin yordayıcılarını belirlemek için kullanılmıştır. Verilerin toplanması için çevrimiçi bir ölçek uygulanmış ve veriler doğrusal regresyon analizleri ile analiz edilmiştir. Araştırmanın sonuçları, algılanan yararlılığın, testin içeriği, hedef beklentisi, algılanan kullanım kolaylığı ve sosyal etki tarafından etkilendiğini ortaya koymuştur. Buna ek olarak, kolaylaştırıcı koşullar ve bilgisayar öz-yeterliliği algılanan kullanım kolaylığını önemli ölçüde yordamaktadır. Ayrıca, algılanan eğlencelik, içerik, amaç beklentisi ve algılanan faydalılıktan etkilenmiştir. Son olarak, algılanan kullanım kolaylığı, algılanan faydalılık ve algılanan eğlenceliğin, web tabanlı dinleme testi kullanma niyetleri üzerinde doğrudan etkilerinin olduğu bulunmuştur. Sonuç olarak, kullanıcılar web tabanlı testleri eğer eğlenceli, kullanışlı ve kolay kullanılabilir olarak algılarlarsa kullanmaktadırlar.

Anahtar Kelimeler

• çevrimiçi test,web tabanlı dinleme testi,teknoloji kabulü,davranışsal niyet,meslek yüksek okulu

References

1. Abedi, J. (2014). The use of computer technology in designing appropriate test accommodations for English language learners. Applied Measurement in Education, 27(4), 261-272.
2. Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179-211.
3. Alderson, J. C. (2000). Technology in testing: The present and the future. System, 28(4), 593–603.
4. Brantmeier, C. (2006). Advanced l2 learners and reading placement: Self-assessment, CBT, and subsequent performance. System, 34(1), 15–35.
5. Choi, I.-C., Kim, K. S., Boo, J., &. (2003). Comparability of a paper-based language test and a computer-based language test. Language Testing, 20(3), 295–320.
6. Chou, C., Moslehpour, M., & Le Huyen, N. T. (2014). Concurrent and predictive validity of computer-adaptive freshman English test for college freshman English in Taiwan. International Journal of English Language Education, 2(1), 143-156.
7. Cigdem, H. & Oncu, S. (2015). E-assessment adaptation at a military vocational college: Student perceptions. Eurasia Journal of Mathematics, Science & Technology Education, 11(5), 971-988. doi:10.12973/eurasia.2015.1368a
8. Cigdem, H., Ozturk, M. & Topcu, A. (2016). Vocational college students’ acceptance of web-based summative listening comprehension test in an EFL course. Computers in Human Behavior, 61, 522–531.

9. Cigdem, H., & Topcu, A. (2015). Predictors of instructors’ behavioral intention to use learning management system: A Turkish vocational college example. Computers in Human Behavior, 52,22–28.
10. Compeau, D. R., & Higgins, C. A. (1995). Computer self-efficacy: development of a measure and Initial test. MIS Quarterly, 19(2), 189–211.
11. Coulter-Kern, R. G., Fogle, K., & Sibert, H. M. (2011). The effect of online quizzing on understanding of key concepts in an introduction to psychology course. Journal of the Indiana Academy of the Social Sciences, 14, (2010-2011).
12. Cushion, S., & Hemard, D. (2003). Designing a call package for Arabic while learning the language Ab Initio. Computer Assisted Language Learning, 16(2–3), 259–266.
13. Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340.
14. Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35, 982–1003.
15. De Kleijn, R. A., Bouwmeester, R. A., Ritzen, M. M., Ramaekers, S. P., & Van Rijen, H. V. (2013). Students’ motives for using online formative assessments when preparing for summative assessments. Medical teacher,35(12), e1644-e1650.
16. Dobson, J. L. (2008). The use of formative online quizzes to enhance class preparation and scores on summative exams. Advances in Physiology Education, 32, 297-302. doi:10.1152/advan.90162.2008.
17. Field, A. P. (2009). Discovering statistics using SPSS: And sex and drugs and rock ‘n’ roll (3. ed.). London: Sage Publications.
18. Fishbein, M., & Ajzen, I. (1975). Belief, Attitude, intention and Behavior: An Introduction to theory and research. Reading, MA: Addison-Wesley.
19. Fritz, K. M. (2003). Using Blackboard five to deliver both traditional and multimedia quizzes on-line for foreign language classes. ERIC Document Reproduction No. ED482584.
20. Henly, D. C. (2003).Use of web-based formative assessment to support student learning in a metabolism/nutrition unit. European Journal of Dental Education, 7,116–122.
21. Hovland, E. (2005). Online testing – A look into the near future. Media & Methods, 41(5), 13.
22. Johnson, B. C., & Kiviniemi, M. T. (2009). The effect of online chapter quizzes on exam performance in an undergraduate social psychology course. Teach Psychology, 36(1), 33-37.
23. Kline, R. B. (2011). Principles and practice of structural equation modeling (3.ed.) New York: The Guilford Press.
24. Lee, J.S. (2006). Exploring the relationship between electronic literacy and heritage language maintenance. Language Learning & Technology, 10(2), 93–113.
25. Liou, H.-C. (2000). Assessing learner strategies using computers: New insights and limitations. Computer Assisted Language Learning, 13(1), 65–78.
26. Llamas-Nistal, M., Fernández-Iglesias, M. J., González-Tato, J., & Mikic-Fonte, F. A. (2013). Blended e-assessment: Migrating classical exams to the digital world. Computers & Education, 62, 72-87.
27. Lu, J., Liu, C., Yu, C., & Wang, K. (2008). Determinants of accepting wireless mobile data services in China. Information & Management, 45(1), 52–64.
28. McCausland, W. D. (2003). Extended case study: Computer aided assessment and independent learning in macroeconomics. Bristol: University of Bristol. http://www. economicsnetwork. Ac.uk/showcase/ext_causland.htm, 06.01.2015.
29. Moon, J., & Kim, Y. (2001). Extending the TAM for a world-wide-web context. Information and Management, 38(4), 217–230.
30. Orr, R., & Foster, S. (2013). Increasing student success using online quizzing in introductory (majors) biology. CBE—Life Sciences Education, 12, 509-514.
31. Prensky, M. (2001). Digital natives, digital immigrants. On the Horizon, 9(5), 1-6.
32. Skrabut, S. A. (2006). Online quizzing: Is it an effective method for preparing civil air patrol cadetsfor their aerospace education examinations? http://www.uwyo.edu/skra but/docs/edre5530_researchproposal.pdf, 06.01.2015.
33. Sorensen, E. (2013). Implementation and student perceptions of e-assessment in a Chemical Engineering module. European Journal of Engineering Education, 38 (2), 172-185.
34. Tabachnick, G. G. & Fidell, L. S. (2007). Experimental designs using ANOVA. Belmont, CA: Duxbury.
35. Terzis, V., & Economides, A. A. (2011). The acceptance and use of computer based assessment. Computers & Education, 56(4), 1032–1044.
36. Venkatesh, V. (1999). Creation of favorable user perceptions: Exploring the role of intrinsic motivation. MIS Quarterly, 23, 239–260.
37. Venkatesh, V., & Davis, F. D. (1996). A model of the antecedents of perceived ease of use: Development and test. Decision Sciences, 27, 451–481.
38. Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: four longitudinal field studies. Management Science, 46, 186–204.
39. Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: toward a unified view. MIS Quarterly, 27(3), 425–478.
40. Wang, Y. (2003). Assessment of learner satisfaction with asynchronous electronic learning systems. Information and Management, 41(1), 75–86.
41. Wang, Y.-S.,Wu, M.-C., &Wang, H.-Y. (2009). Investigating the determinants and age and gender differences in the acceptance of mobile learning. British Journal of Educational Technology, 40(1), 92–118.
42. Zgraggen, F. D. (2009). The effects of frequent testing in the mathematics classroom graduate degree/major: MS education research adviser: James Lehmann, Ph. D. (Doctoral dissertation, University of Wisconsin-Stout).