On the effectiveness and limitations of captioning in L2 listening

Year 2021, Volume: 5 Issue: 2, 516 - 536, 31.12.2021

Saadet Korucu-kış

Abstract

Listening is often perceived to be the most challenging skill by second/foreign language (L2) learners. Due to its real-time nature, L2 listeners experience several comprehension problems related to the processing of aural input. To scaffold L2 listening, captioning is commonly used since the dual coding of aural and written stimuli is expected to make L2 input more comprehensible leading to more in-depth processing. However, a survey of the extant literature precludes us from drawing firm conclusions about the effectiveness of captioning since in some circumstances captions were found to have no significant effect on listening comprehension. So, the question of whether captions function as a comprehension aid in L2 listening remains inconclusive. Hence, adopting a narrative literature review methodology, the present study aims to contribute to this inconsistent research area by clarifying some of these issues answering the following questions: (1) Is captioning really effective in L2 listening?, (2) Does captioning always work for L2 listening?, and (3) Why is research on captioning in L2 listening still inconclusive? Based on the insights gained, it is concluded that the mere presence of captions does not necessarily lead to improved comprehension. Captioning effectiveness is influenced by learner, material, measurement, task, and L1/L2 characteristics. Implications arising are discussed.

Keywords

Captioning, L2 listening, comprehension, audiovisual materials

References

• Aldera, A. S., & Mohsen, M. A. (2013). Annotations in captioned animation: Effects on vocabulary learning and listening skills. Computers & Education, 68, 60–75. https://doi:10.1016/j.compedu.2013.04.018
• Bairstow, D., & Lavaur, J. (2012). Audiovisual information processing by monolinguals and bilinguals: Effects of intralingual and interlingual subtitles. Approaches to Translation Studies, 36, 273–293. https://doi.org/10.1163/9789401207812_016
• Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews. Review of General Psychology, 1(3), 311–320. https://doi.org/10.1037/1089-2680.1.3.311
• Behroozizad, S., & Majidi, S. (2015). The effect of different modes of English captioning on EFL learners’ general listening comprehension: Full text vs. keyword captions. Advances in Language and Literary Studies, 6(4), 115–121. https://www.journals.aiac.org.au/index.php/alls/article/view/1626
• Bianchi, F. & T. Ciabattoni (2008). Captions and subtitles in EFL learning: An investigative study in a comprehensive computer environment. In A. Baldry, M. Pavesi & C. Taylor Torsello (eds.), From didactas to ecolingua (pp. 69-80). Edizioni Universit`a di Trieste.
• Bird, S. A. & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics 23(4), 509–533. https://doi.org/10.1017/S0142716402004022
• Brett, P. (1995). Multimedia for listening comprehension: The design of a multimedia-based resource for developing listening skills. System, 23(1), 77-85. https://doi.org/10.1016/0346-251X(94)00054-A
• Caimi, A. (2006). Audiovisual translation and language learning: The promotion of intralingual subtitles. The Journal of Specialised Translation 6, 85–98. https://www.jostrans.org/issue06/art_caimi.php
• Chai, J., Erlam, R., 2008. The effect and the influence of the use of video and captions on second language learning. New Zealand Studies in Applied Linguistics, 14(2), 25-44.
• https://search.informit.org/doi/10.3316/INFORMIT.997746379301329
• Danan, M. (2004). Captioning and subtitling: Undervalued language learning strategies. Meta 49(1), 67–77. http://www.erudit.org/revue/meta/2004/v49/n1/009021ar.html
• De Jong, N. (2005) Can second language grammar be learned through listening? An experimental study. Studies of Second Language Acquisition, 27(2), 205–34 https://doi.org/10.1017/S0272263105050114
• Diao, Y., Chandler, P., & Sweller, J. (2007). The effect of written text on comprehension of spoken English as a foreign language. American Journal of Psychology, 120(2), 237–261. https://www.jstor.org/stable/20445397
• Gary, J., & Gary, N. (1981). Caution: Talking may be dangerous to your linguistic health. International Review of Applied Linguistics in Language Teaching, 19(1), 1–14. https://doi.org/10.1515/iral.1981.19.1-4.1
• Garza, T. J. (1991) Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals, 24(3), 239–258. https://doi.org/10.1111/j.1944-9720.1991.tb00469.x
• Goh, C.C., 2000. A cognitive perspective on language learners’ listening comprehension problems. System 28(1), 55-75. https://doi.org/10.1016/S0346-251X(99)00060-3
• Guillory, H. G. (1998). The effects of key word captions to authentic French video in foreign language instruction. CALICO Journal, 15(1-3), 89-108. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.494.3324&rep=rep1&type=pdf
• Hwang, G. J., Hsu, T. C., & Hsieh, Y. H. (2018). Impacts of different smartphone caption/subtitle mechanisms on English listening performance and perceptions of students with different learning styles. International Journal of Human–Computer Interaction, 35(4–5), 1–12. https://doi.org/10.1080/10447318.2018.1543091
• Hayati, A. and Mohmedi, F. (2011), The effect of films with and without subtitles on listening comprehension of EFL learners. British Journal of Educational Technology, 42(1), 181–192. https://doi.org/10.1111/j.1467-8535.2009.01004.x
• Hsieh, Y. (2020). Effects of video captioning on EFL vocabulary learning and listening comprehension. Computer Assisted Language Learning, 33(5-6), 567–589. https://doi.org/10.1080/09588221.2019.1577898
• Huang, H. C. & Eskey, D. E. (1999) The effects of closed-captioned television on the listening comprehension of intermediate English as a second language (ESL) students. Journal of Educational Technology Systems, 28(1), 75–96. https://doi.org/10. 2190/RG06-LYWB-216Y-R27G
• Hui, W. (2007). The effects of captions on Chinese EFL students’ incidental vocabulary acquisition. Chinese English Language Education Association Journal, 30(4), 9–16. http://en.cnki.com.cn/Article_en/CJFDTotal-WYDH200502011.htm
• Jones, R. H. 1997. Beyond ‘listen and repeat’: pronunciation teaching materials and theories of second language acquisition. System, 25(1), 103–12. https://doi.org/10.1016/S0346-251X(96)00064-4
• Krashen, S. D. (1985). The input hypothesis: Issues and implications. Laredo Publishing Company.
• Latifi, M., Mobalegh, A., & Mohammadi, E. (2011). Movies subtitles and the improvement of listening comprehension: Does it help? The Journal of Language Teaching and Learning, 1(2), 18-29. https://dergipark.org.tr/en/download/article-file/209072
• Lee, P.-J., Liu, Y.-T. & Tseng, W.-T. (2019) One size fits all? In search of the desirable caption display for second language learners with different caption reliance in listening comprehension. Language Teaching Research, 25(3), 400-430.
• https://doi.org/10.1177/1362168819856451
• LeLoup, J. W. & Ponterio, R. (2006). Listening: You've got to be carefully taught. Language Learning & Technology, 1(11), 4–15. http://dx.doi.org/10125/44082
• Leveridge, A. N. & Yang, J. C. (2013) Testing learner reliance on caption supports in second language listening comprehension multimedia environments. ReCALL, 25(2), 199–214. https://doi.org/10.1017/S0958344013000074
• Leveridge, A. N. & Yang, J. C. (2014) Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545–559. https://doi.org/10.1080/09588221.2013.776968
• Liversidge, G. B. (1999). The Role of closed captioning in second language acquisition. Bell & Howell Company.
• Markham, P. (1999). Captioned videotapes and second language listening word recognition. Foreign Language Annals, 32(3), 321-328. https://doi.org/10.1111/j.1944-9720.1999.tb01344.x
• Markham, P. L., Peter, L. A. & McCarthy, T. J. (2001) The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5), 439–445. https://doi.org/10.1111/j.1944- 9720.2001.tb02083.x
• Markham, P. & Peter, L. (2003) The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, 31(3), 331–341. https://doi.org/10.2190/ BHUH-420B-FE23-ALA0
• Mayer, R. E. (2005). Principles for managing essential processing in multimedia learning: Segmenting, pretraining, and modality principles. In Mayer, R. E. (ed.), Cambridge handbook of multimedia learning (pp. 169-182). Cambridge University Press. https://doi.org/10.1017/CBO9780511816819.012
• Mayer, R. E., Lee, H., & Peebles, A. (2014). Multimedia learning in a second language: A cognitive load perspective. Applied Cognitive Psychology, 28(5), 653–660. http://dx.doi.org/10.1002/acp.3050
• Montero Perez, M., Noortgate, W. V. D. & Desmet, P. (2013) Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739. https://doi.org/10.1016/j.system.2013.07.013
• Montero Perez, M., Peters, E., Clarebout, G., & Desmet, P. (2014a). Effects of captioning on video comprehension and incidental vocabulary. Language, Learning & Technology, 18(1), 118–141. https://doi.org/10.1080/09588221.2017.1375960
• Montero Perez, M., Peters, E., & Desmet, P. (2014b). Is less more? Effectiveness and perceived usefulness of keyword and full captioned video for L2 listening comprehension. ReCALL, 26(1), 21–43. https://doi.org/10.1017/S0958344013000256
• Nation, I. S. P., & Newton, J. (2009). Teaching ESL/EFL listening and speaking. Routledge.
• Pujola, J.-T. (2002). CALLing for help: Researching language learning strategies using help facilities in a web-based multimedia program. ReCALL, 14(2), 235–262. https://doi.org/10.1017/S0958344002000423
• Pujadas, G. & Munoz, C. (2019) Extensive viewing of captioned and subtitled TV series: A study of L2 vocabulary learning by ˜ adolescents. The Language Learning Journal, 47(4), 479–496. https://doi.org/10.1080/09571736.2019.1616806
• Robin, R. (2007). Commentary: Learner-based listening and technological authenticity. Language Learning & Technology,1(11), 109–115. http://dx.doi.org/10125/44092
• Paivio, A. (1986). Mental representation: A dual-coding approach. Oxford University Press.
• Richards, J. (2005) Second thoughts on teaching listening. RELC Journal, 36(1), 85–92. https://doi.org/10.1177/0033688205053484
• Richards, J. (2008). Teaching speaking and listening. Cambridge University Press.
• Rodgers, M. R. H., & Webb, S. (2017). The effects of captions on EFL learners’ comprehension of English-language television programs. CALICO Journal, 34(1), 20–38. https://doi.org/10.1558/cj.29522
• Rost, M. (2011). Teaching and researching listening (2nd ed.). Pearson Education Ltd.
• Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129-158. https://doi.org/10.1093/applin/11.2.129
• Seferoğlu, G. (2008). Using feature films in language classes. Educational Studies, 34(1), 1–9. https://doi.org/10.1080/03055690701785202
• Staehr, L.S., (2009). Vocabulary knowledge and advanced listening comprehension in English as a foreign language. Studies in Second Language Acquisition 31(4), 577-607. https://doi.org/10.1017/S0272263109990039
• Stewart, M. A., & Pertusa, I. (2004). Gains to language learners from viewing target language closed captioned films. Foreign Language Annals, 37(1), 438–447. https://doi.org/10.1111/j.1944-9720.2004.tb02701.x
• Syodorenko, T. (2010). Modality of input and vocabulary acquisition. Language Learning & Technology, 2(14), 50–73. http://dx.doi.org/10125/44214
• Taylor, G. (2005) Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38(3), 422–427. https://doi.org/10.1111/j.1944-9720.2005.tb02228.x
• Teng, F. (2017). Flipping the classroom and tertiary level EFL students’ academic performance and satisfaction. The Journal of Asia TEFL, 14(4), 605–620. http://dx.doi.org/10.18823/asiatefl.2017.14.4.2.605
• Teng, F. (2019). Maximizing the potential of captions for primary school ESL students’ comprehension of English-language videos. Computer Assisted Language Learning, 32(7), 1–27. https://doi.org/10.1080/09588221.2018.1532912
• Vandergrift, L. (2003). Orchestrating strategy use: Toward a model of the skilled second language listener. Language Learning, 53(3), 463–496. https://doi.org/10.1111/1467-9922.00232
• Vandergrift, L. (2007) Recent developments in second and foreign language listening comprehension research. Language Teaching, 40(3), 191–210. https://doi.org/10.1017/S0261444807004338
• Vanderplank, R. (1988). The value of teletext subtitles in language learning, ELT Journal 42(4), 272–281. https://doi.org/10.1093/elt/42.4.272
• Vanderplank, R. (1990). Paying attention to the words: Practical and theoretical problems in watching television programmes with uni-lingual (CEEFAX) subtitles. System 18(2), 221–234. https://doi.org/10.1016/0346-251X(90)90056-B
• Vanderplank, R. (2016). “Effects of” and “effects with” captions: How exactly does watching a TV programme with same-language subtitles make a difference to language learners? Language Teaching, 49(2), 235–250. https://doi.org/10.1017/S0261444813000207
• Williams, H. & D. Thorne (2000). The value of teletext subtitling as a medium for language learning. System 28(2), 217–228. https://doi.org/10.1016/S0346-251X(00)00008-7
• Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86. http://dx.doi.org/10125/44203
• Winke, P., Gass, S., & Sydorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye-tracking study. The Modern Language Journal, 97(1), 254–275. https://doi:10.1111/j.1540-4781.2013.01432.x
• Wipf, J. (1984) Strategies for Teaching School Language Listening Comprehension. Foreign Language Annals, 17(4), 345–348. https://www.proquest.com/openview/a8137d6608a0f452daae72fd1a73afe2/1?cbl=1821600&pq-origsite=gscholar
• Yang, J. C., & Chang, P. (2014). Captions and reduced forms instruction: The impact on EFL students’ listening comprehension. ReCALL, 26(1), 44–61. https://doi.org/10.1017/S0958344013000219
• Zanon, N. T. (2006). Using subtitles to enhance foreign language learning. Porta Linguarum, 6, 41-52. https://www.researchgate.net/publication/28178514_Using_Subtitles_To_Enhance_Foreign_Language_Learning