Learners’ Perceptions Towards Dual-Coding in Adaptive Hypermedia Environments: Listening Texts, Keywords and Visuals

Abstract

In this study, 56 participants’ (N= 56) perceptions towards dual coding in design of audio-only listening texts (i.e. re-provision of the same audio-only listening texts in the form of audio-only listening texts + keywords or supplementary contextual visuals + keywords at non-initial phases of the while listening stage) in a hypermedia listening application for foreign language learning (FLL) were investigated. The study also investigated whether there were any differences between the participants’ perceptions in terms of gender, age, job and FLL period. The study was both quantitative and qualitative in nature. The results of the study were analysed with SPSS (i.e. Mean, Std. Deviation, Independent Samples t Test, ANOVA, Pearson Correlation test, Chi-square). The results revealed that the language learners (LLs) were overwhelmingly in favour of the use of the dual coding in design of audio-only listening texts (i.e. re-provision of the same audio-only listening texts in the form of audio-only listening texts + keywords or supplementary contextual visuals + keywords at non-initial phases of while listening stage) in a hypermedia listening application for FLL. The majority of the LLs believed that not only did such a design benefit them in different ways, but it also contributed to the enhancement of their learning. The participants also felt that such a design could and should have been further improved. Moreover, the results revealed that there were significant differences between the participants’ perceptions towards the re-provision of the same audio-only listening texts with keywords, and (supplementary contextual) visuals + keywords.

Keywords

• Hypermedia
• dual-coding
• listening texts
• visuals
• instructional design

References

1. Abobaker, R., & Hussein, I. (2012). Assessing language through computer technology. International Journal of Computer-Assisted Language Learning and Teaching, 2(2), 61–63.
2. Al-Seghayer, K. (2001). The Effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5(4), 202-232.
3. Arnold, D. J. & P. H. Brooks. (1976). Influence of contextual organising material on children’s listening comprehension. Journal of Educational Psychology, 68(6), 711-16. Retrieved on 13 Sep. 2020 from https://doi.org/10.1037/0022-0663.68.6.711
4. Ashworth, D. (1996). Hypermedia and CALL. In Pennington, M.C. (Ed.), The Power of CALL. (pp. 79-95). USA: Athelstan.
5. Baddeley, A. (1992). Working memory. Science, 255, 556-59
6. Baltova, I. (2000). The effects of subtitled and staged video input on the learning and retention of content and vocabulary in a second language. Dissertation Abstracts International, A: The Humanities and Social Sciences, 2016, Apr, 3620-A, IS: ISSN 0419-4209.
7. Baturay, M. H., Daloğlu, A., & Yıldırım, S. (2010). Language practice with multimedia supported web-based grammar revision material. ReCALL, 22(3), 313-31.
8. Bax, S. (2003). CALL - Past, present and future. System, 31, 13-28.

9. Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25(1), 39-53.
10. Brett, P. (1999). The design, implementation and evaluation of a multimedia application for second language listening comprehension. (Unpublished Ph.D. thesis) The University of Wolverhampton. Wolverhampton, UK.
11. Brickell, G. (1993). Navigation and learning style. Australian Journal of Educational Technology, 9(2), 103-114. Cárdenas-Claros, M. S. (2009). Help options in CALL: a systematic review. With Paul Gruba. CALL Journal, 27(1), 69-90
12. Cárdenas-Claros, M. S. (2021). Conceptualizing feedback in computer-based L2 language listening. CALL Journal, Forthcoming, Published online: 01 Jul 2020
13. Carroll, John B. (1977). On learning from being told. In. Wittrock, M. C. (Ed.) Learning and Instruction. (pp. 496-512). Berkeley, CA: McCutchan.
14. Casambre, A. J. (1962). The effect of certain variables in informative speaking on listener comprehension. (Unpublished Ph.D. thesis), Columbus, Ohio State University.
15. Chapelle, C. and Jamieson, J. (1991). Internal and external validity issues in research on CALL effectiveness (pp. 37-60). In Dunkel, P. (Ed.), Computer-assisted language learning and testing: Research issues and practice. Newbury House.
16. Chun, D. M. & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary acquisition. The Modern Language Journal, 80(2), 183-198.
17. Chun, D. M. & Plass, J. L. (1997). Research on text comprehension in multimedia environments. Language Learning & Technology, 1(1), 60-81.
18. Chou, C. (2012). Understanding on-screen reading behaviours in academic contexts: A case study of five graduate English-as-a-Second-language students. Computer Assisted Language Learning, 25(5), 411-33.
19. Comenius, J. A. (1896). The great didactic. London, UK: Adam & Charles Black.
20. Craik, F. I. M., & Lockart, R. S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11(6), 671–684. doi:10.1016/S0022-5371(72)80001-X
21. De Ridder, I. (2002). Are we conditioned to follow links? Highlights in CALL materials and their impact on the reading process. Computer Assisted Language Learning, 13(2), 183-195.
22. Duncan-Howell, J. (2012). Digital mismatch: Expectations and realities of digital competency amongst pre-service education students. Australasian Journal of Educational Technology, 28(5), 827-840. Retrieved on 23 Sept. 2019 from http://www.ascilite.org.au/ajet/ajet28/duncan-howell.html.
23. Gardner, R. C. (1985). Social psychology and second language learning: The role of attitudes and motivation. Baltimore: Edward Arnold.
24. Ginther, A. (2002). Context and content visuals and performance on listening comprehension stimuli. Language Testing, 19(2), 133-67.
25. Goktas, Y., Yildirim, S., & Yildirim, Z. (2009). Main barriers and possible enablers of ICTs integration into pre-service teacher education programs. Educational Technology & Society, 12(1), 193–204.
26. Herron, C., Dubreil, S., Corrie, C., &, Cole, S. P. (2002). A classroom investigation: Can video improve intermediate-level French language Students' ability to learn about a foreign culture? The Modern Language Journal, 86(1), 36-53.
27. Hsu, C.-K., Hwang, G.-J., Chang, Y.-T., & Chang, C.-K. (2013). Effects of video caption modes on English listening comprehension and vocabulary acquisition using handheld devices. Educational Technology & Society, 16(1), 403–414.
28. Jones, L. C., & Plass, J. L. (2002). Supporting listening comprehension and vocabulary acquisition in French with multimedia annotations. The Modern Language Journal, 86(4), 546-561.
29. Kalyuga, S. (2000). When using sound with a text or picture is not beneficial for learning. Australian Journal of Educational Technology¸16(2),161-72.
30. Linebarger, D. L. (2001). Learning to read from television: The effects of using captions and narration. Journal of Educational Psychology, 93(2), 288-298.
31. Lomicka, L. (1998). To gloss or not to gloss: An investigation of reading comprehension online. Language Learning and Technology, 1(4), 1-50.
32. Long, M. H. (1983). Native speaker / non-native speaker conservation and the negotiation of comprehensible input, Applied Linguistics, 4(2), 126-141.
33. Mangiafico, L. F. (1996). The Relative effects of classroom demonstration and individual use of interactive multimedia on second language listening comprehension. (Unpublished Ph.D. thesis) Faculty of Graduate School of Vanderbilt University.
34. Masgoret, A. M., & Gardner, R. C. (2003). Attitudes, motivation, and second language learning: A meta-analysis of studies conducted by Gardner and associates. Language Learning, 53(1), 123-63.
35. Mayer, E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32(1), 1-19.
36. McLoughlin, C. (1999). The implications of the research literature on learning styles for the design of instructional material. Australian Journal of Educational Technology, 15(3), 222-241.
37. Moreno, R., & Mayer, R. E. (2002). Verbal redundancy in multimedia learning: When reading helps listening, Journal of Educational Psychology, 94(1), 156-163.
38. Mosalanejad, L., Shahsavari, S., Sobhanian, S., & Dastpak, M. (2012). The effect of virtual versus traditional learning in achieving competency-based skills. Turkish Online Journal of Distance Education, 13 (2), Retrieved on 12 September 2019 from http://tojde.anadolu.edu.tr/tojde47/index.htm.
39. Mueller, G. (1980). Visual contextual cues and listening comprehension: An Experiment. Modern Language Journal, 64(3), 335-40.
40. Nicholas, H., Lightbown, P. M., & Spada, N. (2001). Recasts as Feedback to Language Learners, Language Learning, 51(4), 719-758.
41. Nunan, D. (1993). Research Methods in Language Learning. USA: CUP.
42. Omagigo, Alice C. (1979). Pictures and second language comprehension: Do they help?” Foreign Language Annals, 12(2), 107-16.
43. Paivio, A. (1986). Mental representation: A dual coding approach, New York: OUP.
44. Paivio, A. (2006). Mind and its evolution: A dual coding theoretical interpretation, Mahwah, NJ, USA: Lawrence Erlbaum Associates, Inc.
45. Peter, M. (1994). Investigation into the design of educational multimedia: Video, interactivity and narrative. (Unpublished Ph.D. thesis) OU, UK
46. Piaget, J. (1993). John Amos Comenius. Retrieved on 21 February 2020 from http/www.ibe.unesco.org/publicationsThinkersPdc/comeniuse.pdf.
47. Platt, E. & F. B. Brooks. (2002). Task engagement: A turning point in foreign language development. Language Learning, 52(2), 365-400.
48. Purnell, K. N., & Solman, R. T (1991). The influence of technical illustrations on students’ comprehension of geography. Reading Research Quarterly, 26(3), 277-299.
49. Reid, J. M. (1987). The learning style preferences of ESL students. TESOL Quarterly, 21(1), 87-111.
50. Richardson, J. T. E. (2003). Dual coding versus relational processing in memory for concrete and abstract words. European Journal of Cognitive Psychology, 15(?), 481-50l.
51. Ridgway, T. (2000). Listening strategies - I beg your pardon? ELT Journal, 54(2), 179-185.
52. Robinson, G. L. (1989). The CLCCS CALL study: Methods, error feedback, attitudes, and achievement. In W. M. Flint Smith (Ed.): Modern Technology in FLE: Applications and Project (pp. 119-33). Lincolnwood, IL: National Textbook Co.
53. Robinson, G. L. (1991). Effective feedback strategies in CALL: Learning theory and empirical research. In P. Dunkel (Ed.) Computer-Assisted Language Learning and Testing: Research Issues and Practice (pp. 155-68). USA, New York: Newbury House.
54. Rubin, J. (1994). A Review of second language listening comprehension research, The Modern Language Journal, 78(2), 199-221.
55. Schmidt, R. W. (1990). The Role of Consciousness in Second Language Learning. Applied Linguistics, 11(2), 129-158.
56. Secules, T., Herron, C., & Tomasello, M. (1992). The effects of video context on foreign language learning. The Modern Language Journal, 76(4), 480-90.
57. Shehadeh, (2002). Comprehensible output, from occurrence to acquisition: An agenda for acquisitional research. A Journal of Research in Language Studies, 52(3), 597-647. Retrieved on 10 September 2021 from https://doi.org/10.1111/1467-9922.00196
58. Sherwood, R. D., Kinzer, C. K., Hasselbring, T. S., & Bransford, J. D. (1987). Macro-contexts for learning: Initial findings and issues. Applied Cognitive Psychology, 1(2), 93-108.
59. Sweller, J. (1999). Instructional Design. Melbourne: ACER.
60. Thompson, V., & Paivio, A. (1994). Memory for pictures and sounds: Independence of auditory and visual codes. Canadian Journal of Experimental Psychology, 48(3), 380-398.
61. Tschirmer, E. (2001). Language acquisition in the classroom: The role of digital video. Computer Assisted Language Learning, 14(3-4), 305-19.
62. Tseng, H. W., & Yeh, H. (2013) Team members’ perceptions of online teamwork learning experiences and building teamwork trust: A qualitative study. Computers & Education, 63, 1–9.
63. Turel, V. (2010). Advanced Turkish. ReCALL, 22(3), 396-401. Retrieved on 19 August 2020 from http://cls.arizona.edu/resources/review-recall-tur3.htm.
64. Turel, V. (2011). Learners' attitudes to repetitious exposure in multimedia listening software. EUROCALL Review, 19 (September), 57-83. Retrieved on 29 July 2020 from http://www.eurocall-languages.org/wordpress/wp-content/uploads/2014/01/review19.pdf.
65. Turel, V. (2014a). Design of cultural differences in hypermedia environments. International Journal of Human Rights and Constitutional Studies, 2(2), 150-170. DOI: 10.1504/IJHRCS.2014.062766
66. Turel, V. (2014b). The use and design of supplementary visuals for the enhancement of listening skills in hypermedia. In C. M. Akrivopoulou, & N. Garipidis (Eds.), Human rights and the impact of ICT in the public sphere: Participation, democracy, and political autonomy (pp. 268-291). Hershey, PA, USA: IGI-Global. DOI: 10.4018/978-1-4666-6248-3.ch016.
67. Turel, V. (2015a). Intelligent design of interactive multimedia listening software (pp. 1-449). Hershey, PA: IGI Global. doi:10.4018/978-1-4666-8499-7
68. Turel, V. (2015b). Intelligent design of captions in interactive multimedia listening environments. In V. Turel (Ed.), Intelligent design of interactive multimedia listening software (pp. 47-74). Hershey, PA: IGI-Global. DOI: 10.4018/978-1-4666-8499-7.ch003
69. Turel, V. (2016). Design and development of interactive multimedia listening software. (2 hrs 49 mins- Video Cast / Video Publication). Hershey, PA: IGI Global. DOI: 10.4018/978-1-4666-9827-7
70. Turel, V. (2018). Adaptive hypermedia in education. In Khosrow-Pour, M. (Ed.), Encyclopaedia of information science and technology, fourth edition (10 Volumes), (pp. 2357-68). Hershey, PA, USA: IGI-Global. DOI: 10.4018/978-1-5225-2255-3
71. Turel, V. (Ed.). (2021a). Design Solutions for Adaptive Hypermedia Listening Software. Hershey, PA: IGI Global. http://doi:10.4018/978-1-7998-7876-6, ISBN13: 9781799878766 | ISBN10: 1799878767 | EISBN13: 9781799878780 | ISBN13 Softcover: 9781799878773
72. Turel, V. (2021b). Listening, Adaptive Hypermedia and Optimum Design. In V. Turel (Eds.), Design Solutions for Adaptive Hypermedia Listening Software (pp. XVIII-LI). IGI Global. https://www.igi-global.com/gateway/chapter/full-text-pdf/282882
73. Turel, V. (2021c). An Instructional Design Model for Design and Development of Adaptive Hypermedia Listening Environments. In V. Turel (Eds.), Design Solutions for Adaptive Hypermedia Listening Software (pp. 31-44). IGI Global. https://doi.org/10.4018/978-1-7998-7876-6.ch002
74. Turel, V., & McKenna, P. (2013). Design of language learning software. In Bin Zou et al. (Eds.). Computer-Assisted Foreign Language Teaching and Learning: Technological Advances (pp. 188-209). USA, Hershey: IGI-Global.
75. Türel, V. (2010). The use of many listening media-types in one multimedia listening application. Proceedings Book. Volume III, IETC – April 26-28, pp. 1601-1612. Istanbul, Turkey. Retrieved on 17 September 2020 from http://www.iet-c.net/publications.php.
76. Türel, V. (2012). Design of feedback in interactive multimedia language learning environments. Linguistik Online, 54(4), 35-49. Retrieved on 26 July 2021 from http://www.linguistik-online.de/54_12/tuerel.pdf.
77. Türel, V. (2013). The use of educational technology at tertiary level. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi [Hacettepe University Journal of Education], 28(2), 482-496. Retrieved on 10 July 2021 from http://www.efdergi.hacettepe.edu.tr/201328-2VEHBİ%20TÜREL.pdf.
78. Türel, V. (2014). Learners’ perceptions towards interactive multimedia environments. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi [Hacettepe University Journal of Education], 29(3), 167-183. Retrieved on 20 July 2021 from http://www.efdergi.hacettepe.edu.tr/201429-3VEHB%C4%B0%20T%C3%9CREL.pdf.
79. Tyler, S. W. et al. (1979). Cognitive effort and memory. Journal of Experimental Psychology: Human Learning & Memory, 5(6), 607-617.
80. Usluel, Y., & Seferoğlu, S. S. (2004). The perceptions of academic staff members in faculties of education regarding their self-efficacy in relation to computer use, their use of IT, and their perceptions of obstacles in the use of IT, and solutions they propose for those problems (in Turkish). Educational Sciences and Practice (Eğitim Bilimleri ve Uygulama), 6(3), pp. 143-157.
81. Xue, G. at el. (2010) Greater neural pattern similarity across repetitions is associated with better memory. Science, 1:330(6000), 97-101.
82. Vygotsky, L. (1978). Mind in society: The development of higher psychological processes. Cambridge MA: Harvard University Press.
83. Yu, W-K., Sun, Y-C., & Chang, Yu-J. (2010). When technology speaks language: An evaluation of course management systems used in a language learning context. ReCALL, 22(3), 332-355.