Action research as a tool of teaching ESP in a flipped learning environment

Abstract

This study aims to contextualize a flipped learning environment for ESP learners at a faculty of pharmacy, considering learners’ suggestions and the teacher-researcher’s field notes and benefitting from the collaboratively problem-solving processes of action research. Thus, the study was designed as first-person action research, where the teacher-researcher collaborated with the 38 pharmacy students taking an EOP course in their third year of study at a university in Turkey. The flipped learning instruction was evaluated, firstly, during implementation via video-recording 12 weekly three-class-hour courses, collecting learners’ reflective journals and keeping field notes; and secondly, after finishing the implementation by holding focus group interviews with the students. The data were analyzed by inductive content analysis. The findings of the study indicate that the flipped learning strategy ensured many advantages, including the efficient use of class time, differentiation and peer interaction as well as bringing adoption problems derived from teacher dependence and established learning habits. Conducting action research not only improved the teacher-researcher’s relationships with the students but also contributed to her professional identity as an ESP practitioner. Considering the findings of the study, practical implications for professional practice as well as suggestions for further research were presented.

Keywords

• Flipped Learning
• English for Specific Purposes
• Educational Action Research
• Course Design

References

1. Abaeian, H., & Samadi, L. (2016). The effect of flipped classroom on Iranian EFL learners’ L2 reading comprehension: Focusing on different proficiency levels. Journal of Applied Linguistics and Language Research, 3(6), 295-304. Retrieved from http://www.jallr.com/index.php/JALLR/article/view/442
2. Adnan, M. (2017). Perceptions of senior-year ELT students for flipped classroom: A materials development course. Computer Assisted Language Learning, 30 (3-4), 204-222. doi: 10.1080/09588221.2017.1301958
3. Ahmad, S. Z. (2016). The flipped classroom model to develop Egyptian EFL students’ listening comprehension. English Language Teaching, 9(9). doi: 10.5539/elt.v9n9p166
4. Ahmed, H. D., & Asiksoy, G. (2018). Flipped classroom in language studies: A content analysis of recent articles. Near East University Online Journal of Education (NEUJE),1(1), 11-19. Retrieved from https://dergipark.org.tr/tr/pub/neuje/issue/42721/515508
5. Akçayır, G., & Akçayır, M. (2018). The flipped classroom: A review of its advantages and challenges. Computers & Education, 126,334- 345. doi: 10.1016/j.compedu.2018.07.021
6. Alnuhayt, S. S. (2018). Investigating the use of the flipped classroom method in an EFL vocabulary course. Journal of Language Teaching and Research, 9(2), 236-242. doi:10.17507/jltr.0902.03
7. Amiryousefi, M. (2017). The incorporation of flipped learning into conventional classes to enhance EFL learners’ L2 speaking, L2 listening, and engagement. Innovation in Language Learning and Teaching, 13(2), 147-161. doi:10.1080/17501229.2017.1394307
8. Bakla, A. (2017). Interactive videos in foreign language instruction: A new gadget in your toolbox. Mersin University Journal of the Faculty of Education, 13(1),124-137. doi:10.17860/mersinefd.305769

9. Başal, A. (2015). The implementation of a flipped classroom in foreign language teaching. Turkish Online Journal of Distance Education, 16(4). doi: 10.17718/tojde.72185
10. Bergmann, J., & Sams, A. (2012). Flip your classroom: Reach every student in every class every day. Washington, DC: International Society for Technology in Education.
11. Bishop, J. L., & Verleger, M. A. (2013). The flipped classroom: A survey of the research. Paper presented at the 120th ASEE Annual Conference & Exposition. Atlanta, GA.
12. Bogdan, R. C.& Biklen, S. K. (2007). Qualitative research in education: An introduction to theory and methods (5th ed.). London: Pearson Education, Inc.
13. Boyraz, S., & Ocak, G. (2017). Implementation of flipped education into Turkish EFL teaching context. Journal of Language and Linguistic Studies, 13(2), 426-439. Retrieved from http://www.jlls.org/index.php/jlls/article/view/728
14. Campbell, L.O., Planinz, T., Morris, K., & Truitt, J. (2019). Investigating undergraduate students’ viewing behaviors of academic video in formal and informal settings. College Teaching, 67(4), 211-221. doi: 10.1080/87567555.2019.1650703
15. Chavangklang, T., & Suppasetseree, S. (2018). Enhancing Thai EFL university students’ reading comprehension through a flipped cooperative classroom. PEOPLE: International Journal of Social Sciences, 4(3), 238-261. doi:10.20319/pijss.2018.43. 238261
16. Chen, Y., Wang, Y., Kinshuk, & Chen, N.S. (2014). Is FLIP enough? Or should we use the FLIPPED model instead? Computers & Education, 79, 16–27. doi: 10.1016/j.compedu.2014.07.004
17. Chen Hsieh, J. S., Wu, W.-C. V., & Marek, M. W. (2017). Using the flipped classroom to enhance EFL learning. Computer Assisted Language Learning, 30(1–2),1–21. doi:10.1080/09588221.2015.1111910
18. Chien, Y. T., Chang, Y. H., & Chang, C. Y. (2016). Do we click in the right way? A meta-analytic review of clicker-integrated instruction. Educational Research Review, 17, 1–18. doi: 10.1016/j.edurev.2015.10.003
19. Choe, E., & Seong, M.-H. (2016). A case study of the flipped classroom in a Korean university general English course. Journal of Pan-Pacific Association of Applied Linguistics, 20(2), 71-93. Retrieved from https://eric.ed.gov/?id=EJ1129484
20. Correa, M. (2015). Flipping the foreign language classroom and critical pedagogies: A (new)old trend. Higher Education for the Future, 2 (2), 114–125. doi:10.1177/2347631115584122
21. Creswell, J. W. (2005). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (2nd ed.). Upper Saddle River, New Jersey: Pearson Prentice Hall.
22. Cunningham, U. (2016). Language pedagogy and non-transience in the flipped classroom. Journal of Open, Flexible and Distance Learning, 20(1), 44- 58. Retrieved from https://files.eric.ed.gov/fulltext/EJ1112349.pdf
23. Çalışkan, N. (2016). Examining the influence of flipped classroom on students learning English as a foreign language (Master thesis). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/TezGoster?key=OykDDeWBWTL9- Wm52sZBrBAXlymGhS1udBjzN8QGhPnU59N_J1eRyfsmX-ByPE6z (Thesis ID. 445646).
24. Çetin- Köroğlu, Z., & Çakır, A. (2017). Implementation of flipped instruction in language classrooms: An alternative way to develop speaking skills of pre-service English language teachers. International Journal of Education and Development Using Information and Communication Technology (IJEDICT), 13 (2), 42-55. Retrieved from https://www.semanticscholar.org/paper/Implementation-of-Flipped-Instruction-in-Language-K%C3%B6ro%C4%9Flu-%C3%87ak%C4%B1r/3cafcfbc14194b098e53e4e176464e930b61d392
25. Çevikbaş, M., & Argün, Z. (2017). An innovative learning model in digital age: Flipped classroom. Journal of Education and Training Studies, 5(11), 189-200. doi:10.11114/jets.v5i11.2322
26. DeLozier, S. J., & Rhodes, M. G. (2016). Flipped classrooms: A review of key ideas and recommendations for practice. Educational Psychology Review, 29(1), 141–151. doi: 10.1007/s10648-015-9356-9
27. Doman, E., & Webb, M. (2016). The flipped experience for Chinese university students studying English as a foreign language. TESOL Journal, 8(1), 102- 141. doi: 10.1002/tesj.264
28. Douligeris, C., Seralidou, E., & Gkotsiopoulos, P. (2018). Let's learn with Kahoot! In IEEE Global Engineering Education Conference (EDUCON) (pp. 677-685). Tenerife, Spain. doi: 10.1109/EDUCON.2018.8363296
29. Ekmekçi, E. (2017). The flipped writing classroom in Turkish EFL context: A comparative study on a new model. Turkish Online Journal of Distance Education,18(2), 151-167. doi: 10.17718/tojde.306566
30. Elmaadaway, M.A. (2017). The effects of a flipped classroom approach on class engagement and skill performance in a blackboard course. British Journal of Educational Technology, 49(3), 479-491. doi:10.1111/bjet.12553
31. Engin, M. (2014). Extending the flipped classroom model: Developing second language writing skills through student created digital videos. Journal of the Scholarship of Teaching and Learning, 14(5), 12-26. doi: 10.14434/josotlv14i5.12829
32. Engin, M., & Donanci, S. (2014). Flipping the classroom in an academic writing course. Journal of Teaching and Learning with Technology, 3 (1), 94-98. doi: 10.14434/jotlt.v3n1.4088
33. Erdemir, N., & Yangın Ekşi, G. (2019). The perceptions of student teachers about using an online learning environment ‘Edmodo’ in a ‘flipped classroom’. SDU International Journal of Educational Studies, 6(2), 174-186. doi: 10.33710/sduijes.638795
34. Filiz, S., & Benzet, A. (2018). A content analysis of the studies on the use of flipped classrooms in foreign language education. World Journal of Education, 8(4), 72- 86. doi: 10.5430/wje.v8n4p72
35. Flipped Learning Network (FLN). (2014). The Four Pillars of F-L-I-P™. Retrieved from https://flippedlearning.org/definition-of-flipped-learning/
36. Fulton, K. P. (2012). 10 Reasons to Flip. New Styles of Instruction, 94(2), 20-24. Retrieved from https://www.jstor.org/stable/41763589?seq=1#metadata_info_tab_contents
37. García Laborda, J., & Litzler, M. F. (2015). Current perspectives in teaching English for specific purposes. Onomàzein: Journal of Linguistics, Philology and Translation, 31(1), 38-51. doi: 10.7764/onomazein.31.1
38. Gasmi, A. A. (2016). An exploratory study of students’ lived experiences in a blended-flipped writing class. Arab World English Journal, 3, 210–226. Retrieved from https://awej.org/index.php/special-issues/67-special-issue-on-call-july-2016/962-afef-ahmed-gasmi
39. Gilboy, M. B., Heinerichs, S., & Pazzaglia, G. (2015). Enhancing student engagement using the flipped classroom. Journal of Nutrition Education and Behavior, 47(1), 109-114. doi: 10.1016/j.jneb.2014.08.008.
40. González, J. (2014, March 24). Modifying the flipped classroom: The “in-class version” [Blog post]. Retrieved from https://www.edutopia.org/blog/flipped-classroom-in-class-version-jennifer-gonzalez
41. Graney, J. M. (2018). Flipped learning and formative assessment in an English language class. In J. Mehring &A. Leis (Eds.), Innovations in Flipping the Language Classroom (pp. 59- 68). [eBook] doi: 10.1007/978-981-10-6968-0
42. Güler, A., Halıcıoğlu, M.B.& Taşğın, S. (2013). Sosyal bilimlerde nitel araştırma. [Qualitative research in social sciences]. Ankara: Seçkin Yayıncılık.
43. Hung, H.-T. (2015). Flipping the classroom for English language learners to foster active learning. Computer Assisted Language Learning, 28(1), 81-96. doi:10.1080/09588221.2014.967701
44. Hung, H.-T. (2017a). The integration of a student response system in flipped classrooms. Language Learning & Technology, 21(1), 16–27. Retrieved from http://llt.msu.edu/issues/february2017/hung.pdf
45. Hung, H.-T. (2017b). Design-based research: Redesign of an English language course using a flipped classroom approach. TESOL Quarterly, 51(1), 180-192. doi: 10.1002/tesq.328
46. Hung, H.-T. (2017c). The integration of a student response system in flipped classrooms. Language Learning & Technology, 21(1), 16–27. Retrieved from http://llt.msu.edu/issues/february2017/hung.pdf
47. Hunsu, N. J., Adesope, O., & Bayly, D. J. (2016). A meta-analysis of the effects of audience response systems (clicker-based technologies) on cognition and affect. Computers & Education, 94, 102–119. doi: 10.1016/j.compedu.2015.11.013
48. Insani, H. N., Suherdi, D., & Gustine, G. G. (2018). Undergraduate students’ perspectives in using Edmodo as an educational social network. English review: Journal of English education, 6(2), 61-68. doi: 10.25134/erjee.v6i2.1254.
49. Johns, A.M., & Price, D. (2014). English for specific purposes: International in scope, specific in purpose. In M. Celce-Murcia, D. Brinton & M.A. Snow (Eds.), Teaching English as a second or foreign language, (4th ed., pp. 471-487). Boston: National Geographic Learning.
50. Kang, N. (2015). The comparison between regular and flipped classrooms for EFL Korean adult learners. Multimedia- assisted language learning, 18(3), 41- 72. doi: 10. 15702/mall.2015.18.3.41
51. Karagöl, İ., & Esen, E. (2019). The effect of flipped learning approach on academic achievement: A meta-analysis study. Hacettepe University Journal of Education, 34(3), 708-727. doi: 10.16986/HUJE.2018046755
52. Karimi, M., & Hamzavi, R. (2017). The effect of flipped model of instruction on EFL learners’ reading comprehension: learners’ attitudes in focus. Advances in Language and Literary Studies, 8(1), 95 103. doi: 10.7575/aiac.alls.v.8n.1p.95
53. Khalil, R. M. R., & Fahim, S. S., (2016). Assessment as a learning tool in a flipped English language classroom in higher education. Arab World English Journal (AWEJ),4-19. doi: 10.2139/ssrn.2895534
54. Kocabatmaz, H. (2016). The ideas of pre-service teachers regarding the flipped classroom model. Journal of Research in Education and Teaching, 5(4), 14-24. Retrieved from http://www.jret.org/FileUpload/ks281142/File/02a.handan_kocabatmaz.pdf
55. Lee, G., & Wallace, A. (2018). Flipped learning in the English as a foreign language classroom: Outcomes and perceptions. TESOL Quarterly, 52(1), 62- 84. doi: 10.1002/tesq.372
56. Leis, A. (2016). Flipped learning and EFL proficiency: An empirical study. TELES Journal, 36,77- 90. Retrieved from https://www.researchgate.net/publication/303759005_Flipped_Learning_and_EFL_Pr oficiency_An_Empirical_Study
57. Lin, C. J., & Hwang, G. J. (2018). A learning analytics approach to investigating factors affecting EFL students' oral performance in a flipped classroom. Journal of Educational Technology & Society, 21(2), 205-219. Retrieved from https://www.j- ets.net/ETS/journals/21_2/18.pdf
58. Lo, C. K., & Hwang, G. J. (2018). How to advance our understanding of flipped learning: Directions and a descriptive framework for future research. Knowledge Management & E-Learning, 10(4), 441–454. doi: 10.34105/j.kmel.2018.10.027
59. Long, T., Cummins, J., & Waugh, M. (2017). Use of the flipped classroom instructional model in higher education: Instructors’ perspectives. Journal of Computing in Higher Education, 29(2),179-200. doi: 10.1007/s12528-016-9119-8
60. Long, T., Cummins, J., & Waugh, M. (2019). To flip or not in higher education: A tale of three instructors. The Asia-Pacific Education Researcher. doi:10.1007/s40299-019- 00470-4
61. Long, T., Logan, J., & Waugh, M. (2016). Students’ perceptions of the value of using videos as a pre-class learning experience in the flipped classroom. TechTrends,60 (3), 245– 252.
62. Marks, D.B. (2015). Flipping the classroom: Turning an instructional methods course upside down. Journal of College Teaching & Learning (TLC), 12(4), 241–248. doi: 10.19030/tlc.v12i4.9461
63. McNally, B., Chipperfield, J., Dorsett, P., Fabbro, L.D., Frommolt, V., Goetz, S.,…Rung, A. (2017). Flipped classroom experiences: Student preferences and flip strategy in a higher education context. Higher Education, 73(2), 281-298. doi:10.1007/s10734-016-0014-z
64. McNiff, J., Lomax, P., & Whitehead, J. (1996). You and your Action Research Project. New York: Routledge.
65. McKeown, J. (2016). From “sage on the stage to guide on the side”: A case study of a transition to flipped English language learning in a higher education setting in Turkey. ELT Research Journal, 5(2), 145-154. Retrieved from http://dergipark.ulakbim.gov.tr/eltrj/article/view/5000194876
66. Mehring, J. (2015). An exploratory study of the lived experiences of Japanese undergraduate EFL students in the flipped classroom. Paper presented at the 4th International Conference on Communications and Information Technology. ICCIT, Abu Dhabi. Retrieved from https://www.semanticscholar.org/paper/An-exploratory-study-of-the- lived-experiences-of-in-
67. Mehring/60c55cc8b938920925a1420faf1b101c98f4d0cd#citing-papers
68. Mehring, J. (2016). Present research on the flipped classroom and potential tools for the EFL classroom. Computers in the Schools, 33(1), 1-10. doi: 10.1080/07380569.2016.1139912
69. Mehring, J. (2018). The flipped classroom. In J. Mehring &A. Leis (Eds.), Innovations in Flipping the Language Classroom (pp. 203- 220). [eBook]doi:10.1007/978-981-10- 6968-0
70. Nguyen, T. (2018). Implementation of English flipped classrooms: Students’ perceptions and teacher’s reflection. International Journal of Research Studies in Language Learning,7(3), 87-108. doi: 10.5861/ijrsll.2017.1876
71. Onodipe, G., & Ayadi, M. F. (2020). Using smartphones for formative assessment in the flipped classroom. Journal of Instructional Pedagogies,23,1-20. Retrieved from https://eric.ed.gov/?id=EJ1241944
72. Öznacar, B., Köprülü, F., & Çağlar, M. (2019). The success of implementing flipped classroom in teaching foreign language for international students. BRAIN: Broad Research in Artificial Intelligence and Neuroscience, 10 (2), 151- 158. Retrieved from http://www.edusoft.ro/brain/index.php/brain/article/view/913
73. Patton, M. Q. (2002). Qualitative Research& Evaluation Methods. (3rd ed.). Thousand Oaks, London, New Delhi: Sage Publications.
74. Pavanelli, R. (2018). The flipped classroom: A mixed methods study of academic performance and student perception in EAP writing context. International Journal of Language and Linguistics, 5(2), 16- 26. doi:10.30845/ijll.v5n2p3
75. Pinna, G., Mena, J., & Funes, S. (2017). Undergraduate students' perceptions about the use of Kahoot as part of the flipped classroom methodology. In Editors: M. Á. C. González, F. J. R. Sedano, C. F. Llamas, & F. J. García-Peñalvo (Eds.), TEEM'19: Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality (pp. 619–625). New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3362789.3362900
76. Purnawarman, P., Susilawati, S., & Sundayana, W. (2016). The use of Edmodo in teaching writing in a blended learning setting. Indonesian Journal of Applied Linguistics, 5(2), 242-252. doi:10.17509/ijal.v5i2.1348
77. Ramirez, M. (2018) In-Class Flip: Flipping a Literature Class for Student-Centered Learning. In J. Mehring & A. Leis (Eds.), Innovations in Flipping the Language Classroom (pp. 93-103). [eBook] doi: 10.1007/978-981-10-6968-0
78. Rochmahwati, P. (2014). Developing learner autonomy online through micro blogging Edmodo. Lingua Scientia, 6(2), 151-158. doi: 10.21274/ls.2014.6.2.213-221
79. Roehl, A., Reddy, S. L., & Shannon, G. J. (2013). The flipped classroom: An opportunity to engage millennial students through active learning strategies. Journal of Family & Consumer Sciences, 105(2), 44-49. Retrieved from https://pdfs.semanticscholar.org/daa3/b94cdc7b52b3381a7c7e21022a7a8c005f84.pdf
80. Sakulprasertsri, K. (2017). Flipped learning approach: Engaging 21st century learners in English classrooms. LEARN journal: Language education and acquisition research network journal, 10(2). Retrieved from https://www.tci- thaijo.org/index.php/LEARN/article/view/111741/87203
81. Sams, A., &Bergmann, J. (2013). Flip your students learning. Educational Leadership,70(6), 16-20. Retrieved from http://www.ascd.org/publications/educational-leadership/mar13/vol70/num06/Flip-Your-Students'-Learning.aspx
82. Schwartz, T. A., Andridge, R.R., Sainani, K. L., Stangle, D. K., & Neely, M. L. (2016). Diverse perspectives on a flipped biostatistics classroom. Journal of Statistics Education, 24(2), 74-84. doi: 10.1080/10691898.2016.1192362
83. Serafim, V. F., & Meireles, A. R. (2019). Affordances of Edmodo for the flipping and expansion of the L2 classroom. BELT - Brazilian English Language Teaching Journal, 9(2), 293-307. doi: 10.15448/2178-3640.2018.2.31963
84. Suranakkharin, T. (2017). Using the flipped model to foster Thai learners’ second language collocation knowledge. 3L: The Southeast Asian Journal of English Language Studies, 23(3), 1 – 20.doi: 10.17576/3L-2017-2303-01
85. Sun, Y.-C. (2017). Flipping every student? A case study of content-based flipped language classrooms. E-Learning and Digital Media, 14(1–2), 20–37. doi: 10.1177/2042753017692428
86. Şahin, M., & Fell Kurban, C. (2016). The flipped approach to higher education: Designing universities for today’s knowledge economies and societies. Bingley: Emerald Group Publishing Limited.
87. Tucker, C. (2016, January, 7). In-class flip: The flipped classroom meets station rotation model [Blog post]. Retrieved from https://catlintucker.com/2016/01/inclassflip/
88. Turan, Z. (2015). The evaluation of flipped classroom method and examination of its effects on academic achievement, cognitive load and motivation. (Doctoral dissertation). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/
89. Turan, Z., & Akdag-Cimen, B. (2019). Flipped classroom in English language teaching: A systematic review. Computer Assisted Language Learning,1, 1-17. doi: 10.1080/09588221.2019.1584117 [Taylor & Francis Online]
90. Turan, Z., & Göktaş, Y. (2015). Yükseköğretimde yeni bir yaklaşım: Öğrencilerin ters yüz sınıf yöntemine ilişkin görüşleri [A new approach in higher education: The students’ views on flipped classroom method]. Yükseköğretim ve Bilim Dergisi,5(2), 156-164. doi: 10.5961/jhes.2015.118
91. Wagner-Loera, D. (2018). Flipping the ESL/ EFL classroom to reduce cognitive load: A new way of organizing your classroom. In J. Mehring &A. Leis (Eds.), Innovations in Flipping the Language Classroom (pp. 169-184). [eBook] doi: 10.1007/978-981-10- 6968-0
92. Wang, F.H. (2017). An exploration of online behaviour engagement and achievement in flipped classroom supported by learning management system. Computers & Education, 114, 79-91. doi: 10.1016/j.compedu.2017.06.012
93. Wang, Y., & Qi, G. Y. (2018). Mastery-based language learning outside class: Learning support in flipped classrooms. Language Learning & Technology, 22(2), 50–74. doi:10125/44641
94. Webb, M., & Doman, E. (2016). Does the flipped classroom lead to increased gains on learning outcomes in ESL/EFL contexts? The CATESOL Journal, 28(1), 39-67. Retrieved from http://www.catesoljournal.org/wp-content/uploads/2016/06/CJ28.1_webb.pdf
95. Webb, M., Doman, E., & Pusey, K. (2014). Flipping a Chinese university EFL course: What students and teachers think of the model. The Journal of Asia TEFL, 11(4), 53-87. Retrieved from http://www.asiatefl.org/main/download_pdf.php?i=389&c=1420009720&fn=
96. Yıldırım, A., & Şimşek, H. (2013). Sosyal bilimlerde nitel araştırma yöntemleri. [The qualitative research methods in social sciences]. (9th ed.). Ankara: Seçkin Yayıncılık.
97. Zainuddin, Z. (2017). First-year college students’ experiences in the EFL flipped classroom: A case study in Indonesia. International Journal of Instruction, 10(1), 133- 150. doi:10.12973/iji.2017.1019a
98. Zainuddin, Z., Haruna, H., Li, X., Zhang, Y., Chu, S. K. W. (2019). A systematic review of flipped classroom empirical evidence from different fields: What are the gaps and future trends? On the Horizon, 27(2), 72-86. doi:10.1108/OTH-09-2018-0027
99. Zhang, Y., Chen, B.-L., Ge, J., Hung, C. Y. & Mei, L. (2019) When is the best time to use rubrics in flipped learning? A study on students’ learning achievement, metacognitive awareness, and cognitive load. Interactive Learning Environments, 27(8), 1207-1221. doi: 10.1080/10494820.2018.1553187
100. Zou, D., & Xie, H. (2019). Flipping an English writing class with technology-enhanced just-in-time teaching and peer instruction. Interactive Learning Environments, 27(8), 1127-1142. doi: 10.1080/10494820.2018.1495654