The Impact of Online Annotation Tools on Students’ Academic Performance in a Distance University Program
Year 2020,
Volume: 21 Issue: 2, 167 - 177, 01.04.2020
Carmen Benıtez
Ana Quınones
Paul Gonzalez
Cesar Ochoa
Alba Vargas
Abstract
The present study aims to test the effectiveness of the Nota Bene (NB) software as an on line annotation tool to enhance students’ academic performance and to know their perceptions about the use of this tool. In this research, a quasi-experimental design was used in a private university in Ecuador. The participants were ninety-eight pre-service EFL teachers, who were trained during a five-month period and divided into two groups: control and experimental. They took a pre and a post-test at the beginning and at the end of the training period. The students from the experimental group answered a questionnaire about the perceptions on the use of NB. The statistically significant differences found in the results of the post-test indicate that NB is an effective software to enhance participants’ academic performance. In addition, the students who used this tool had positive perceptions about the use of NB while doing their academic activities.
References
- Azouaou, F., Chen, W., Desmoulins, C. (2004). Semantic annotation for learning material. In: Proceedings
of Semantic Web and e-Learning Workshop, Adaptive Hypermedia, AH’04, Vol. 2. CS-Report 04-19.
Eindhoven University of Technology, (pp. 359–364).
Borham-Puyal, M., & Olmos-Miguelanez, S. (2011). Improving the use of feedback in an online teachinglearning environment: An experience supported by Moodle. US-China Foreign Language, 9(6),
371-382.
Bottoni P., Levialdi S., Rizzo P. (2003). An analysis and case study of digital annotation. In: BianchiBerthouze N. (eds) Databases in Networked Information Systems. DNIS 2003. Lecture Notes in
Computer Science, vol 2822. Springer, Berlin, Heidelberg. doi: https://doi.org/10.1007/978-3-
540-39845-5_18.
Burghardt, M. (2012). Usability recommendations for annotation tools. In Proceedings of the Sixth Linguistic
Annotation Workshop (pp. 104-112). Association for Computational Linguistics.
Creswell, J. W. (2015). Educational research: Planning, conducting, and evaluating quantitative and qualitative
research. New Jersey: Upper Saddle River.
Gao, F. (2013). A case study of using a social annotation tool to support collaboratively learning. The Internet
and Higher Education, 17, 76-83. doi: https://doi.org/10.1016/j.iheduc.2012.11.002.
176
Glover, I., Xu, Z., & Hardaker, G. (2007). Online annotation–Research and practices. Computers &
Education, 49(4), 1308-1320. doi: https://doi.org/10.1016/j.compedu.2006.02.006.
Hwang, W. Y., Shadiev, R., & Huang, S. M. (2010). Effect of multimedia annotation system on improving
English writing and speaking performance. In International Conference on Technologies for
E-Learning and Digital Entertainment (pp. 1-12). Springer, Berlin, Heidelberg.
Hwang, W. Y., Wang, C. Y., & Sharples, M. (2007). A study of multimedia annotation of Web-based materials.
Computers & Education, 48(4), 680-699. doi: https://doi.org/10.1016/j.compedu.2005.04.020.
Johnson, T. E., Archibald, T. N., & Tenenbaum, G. (2010). Individual and team annotation effects on
students’ reading comprehension, critical thinking, and meta-cognitive skills. Computers in human
behavior, 26(6), 1496-1507.doi: https://doi.org/10.1016/j.chb.2010.05.014.
Karger (2019) https://oeit.mit.edu/gallery/projects/nb-pdf-annotation-tool/
Kawase, R., Herder, E., & Nejdl, W. (2009). A comparison of paper-based and online annotations in the
workplace. In European Conference on Technology Enhanced Learning (pp. 240-253). Springer,
Berlin, Heidelberg.
Krouska, A., Troussas, C., & Virvou, M. (2018, July). Social Annotation Tools in Digital Learning: A
Literature Review. In 2018 9th International Conference on Information, Intelligence, Systems
and Applications (IISA) (pp. 1-4). IEEE.
Miller, K., Lukoff, B., King, G., & Mazur, E. (2018). Use of a social annotation Platform for Pre-class reading
assignments in a Flipped Introductory Physics class. In Frontiers in Education (3) 8. Frontiers. doi:
https://doi.org/10.3389/feduc.2018.00008.
Murugaiah, P., & Thang, S. M. (2010). Development of interactive and reflective learning among Malaysian
online distant learners: An ESL instructor’s experience. The International Review of Research in
Open and Distributed Learning, 11(3), 21-41. doi: https://doi.org/10.19173/irrodl.v11i3.84.
nb (2019) http://nb.mit.edu/about/
Nokelainen, P., Kurhila, J., Miettinen, M., Floreen, P., & Tirri, H. (2003). Evaluating the role of a shared
document-based annotation tool in learner-centered collaborative learning. In Proceedings 3rd
IEEE International Conference on Advanced Technologies (pp. 200-203). IEEE. doi: https://doi.
org/10.1109/ICALT.2003.1215056.
Novak, E., Razzouk, R., & Johnson, T. E. (2012). The educational use of social annotation tools in higher
education: A literature review. The Internet and Higher Education, 15(1), 39-49. doi: https://doi.
org/10.1016/j.iheduc.2011.09.002.
Nunes, B. P., Kawase, R., Dietze, S., de Campos, G. H. B., & Nejdl, W. (2012). Annotation tool for
enhancing e-learning courses. In International Conference on Web-Based Learning pp. 51-60.
Springer, Berlin, Heidelberg. doi: https://doi.org/10.1007/978-3-642-33642-3_6
OEIT - MIT (2019) https://oeit.mit.edu/category/keywords/pdf/index.html
Shaked, H., Schechter, C., & Michalsky, T. (2018). Collaborative learning from personal cases in a principal
preparation programme. International Journal of Leadership in Education, 21(4), 479-490. doi:
https://doi.org/10.1080/13603124.2016.1151942.
Sun, Y., & Gao, F. (2017). Comparing the use of a social annotation tool and a threaded discussion forum
to support online discussions. The Internet and Higher Education, 32, 72-79. doi: 10.1016/j.
iheduc.2016.10.001
Tezci, E. (2009). Teachers’ effect on ICT use in education: The Turkey sample. Procedia-Social and Behavioral
Sciences, 1(1), 1285-1294. doi: https://doi.org/10.1016/j.sbspro.2009.01.228.
Wright, L. K., Zyto, S., Karger, D. R., & Newman, D. L. (2013). Online Reading Informs Classroom
Instruction and Promotes Collaborative Learning. Journal of College Science Teaching, 43(2),
44-53.
177
Yang, X., Yu, S., & Sun, Z. (2013). The effect of collaborative annotation on Chinese reading level in
primary schools in China. British Journal of Educational Technology, 44(1), 95-111. doi: https://
doi.org/10.1111/j.1467-8535.2011.01277.x
Yeh, H. C., Hung, H. T., & Chiang, Y. H. (2017). The use of online annotations in reading instruction and
its impact on students’ reading progress and processes. ReCALL, 29(1), 22-38. doi: https://doi.
org/10.1017/S0958344016000021.
Yeh, S. W., & Lo, J. J. (2009). Using online annotations to support error correction and corrective feedback.
Computers & Education, 52(4), 882-892. doi: https://doi.org/10.1016/j.compedu.2008.12.014.
Zyto, S., Karger, D., Ackerman, M., & Mahajan, S. (2012). Successful classroom deployment of a social
document annotation system. In Proceedings of the SIGCHI Conference on Human Factors in
Computing Systems (pp. 1883-1892). ACM. doi: https://doi.org/10.1145/2207676.2208326.
Year 2020,
Volume: 21 Issue: 2, 167 - 177, 01.04.2020
Carmen Benıtez
Ana Quınones
Paul Gonzalez
Cesar Ochoa
Alba Vargas
References
- Azouaou, F., Chen, W., Desmoulins, C. (2004). Semantic annotation for learning material. In: Proceedings
of Semantic Web and e-Learning Workshop, Adaptive Hypermedia, AH’04, Vol. 2. CS-Report 04-19.
Eindhoven University of Technology, (pp. 359–364).
Borham-Puyal, M., & Olmos-Miguelanez, S. (2011). Improving the use of feedback in an online teachinglearning environment: An experience supported by Moodle. US-China Foreign Language, 9(6),
371-382.
Bottoni P., Levialdi S., Rizzo P. (2003). An analysis and case study of digital annotation. In: BianchiBerthouze N. (eds) Databases in Networked Information Systems. DNIS 2003. Lecture Notes in
Computer Science, vol 2822. Springer, Berlin, Heidelberg. doi: https://doi.org/10.1007/978-3-
540-39845-5_18.
Burghardt, M. (2012). Usability recommendations for annotation tools. In Proceedings of the Sixth Linguistic
Annotation Workshop (pp. 104-112). Association for Computational Linguistics.
Creswell, J. W. (2015). Educational research: Planning, conducting, and evaluating quantitative and qualitative
research. New Jersey: Upper Saddle River.
Gao, F. (2013). A case study of using a social annotation tool to support collaboratively learning. The Internet
and Higher Education, 17, 76-83. doi: https://doi.org/10.1016/j.iheduc.2012.11.002.
176
Glover, I., Xu, Z., & Hardaker, G. (2007). Online annotation–Research and practices. Computers &
Education, 49(4), 1308-1320. doi: https://doi.org/10.1016/j.compedu.2006.02.006.
Hwang, W. Y., Shadiev, R., & Huang, S. M. (2010). Effect of multimedia annotation system on improving
English writing and speaking performance. In International Conference on Technologies for
E-Learning and Digital Entertainment (pp. 1-12). Springer, Berlin, Heidelberg.
Hwang, W. Y., Wang, C. Y., & Sharples, M. (2007). A study of multimedia annotation of Web-based materials.
Computers & Education, 48(4), 680-699. doi: https://doi.org/10.1016/j.compedu.2005.04.020.
Johnson, T. E., Archibald, T. N., & Tenenbaum, G. (2010). Individual and team annotation effects on
students’ reading comprehension, critical thinking, and meta-cognitive skills. Computers in human
behavior, 26(6), 1496-1507.doi: https://doi.org/10.1016/j.chb.2010.05.014.
Karger (2019) https://oeit.mit.edu/gallery/projects/nb-pdf-annotation-tool/
Kawase, R., Herder, E., & Nejdl, W. (2009). A comparison of paper-based and online annotations in the
workplace. In European Conference on Technology Enhanced Learning (pp. 240-253). Springer,
Berlin, Heidelberg.
Krouska, A., Troussas, C., & Virvou, M. (2018, July). Social Annotation Tools in Digital Learning: A
Literature Review. In 2018 9th International Conference on Information, Intelligence, Systems
and Applications (IISA) (pp. 1-4). IEEE.
Miller, K., Lukoff, B., King, G., & Mazur, E. (2018). Use of a social annotation Platform for Pre-class reading
assignments in a Flipped Introductory Physics class. In Frontiers in Education (3) 8. Frontiers. doi:
https://doi.org/10.3389/feduc.2018.00008.
Murugaiah, P., & Thang, S. M. (2010). Development of interactive and reflective learning among Malaysian
online distant learners: An ESL instructor’s experience. The International Review of Research in
Open and Distributed Learning, 11(3), 21-41. doi: https://doi.org/10.19173/irrodl.v11i3.84.
nb (2019) http://nb.mit.edu/about/
Nokelainen, P., Kurhila, J., Miettinen, M., Floreen, P., & Tirri, H. (2003). Evaluating the role of a shared
document-based annotation tool in learner-centered collaborative learning. In Proceedings 3rd
IEEE International Conference on Advanced Technologies (pp. 200-203). IEEE. doi: https://doi.
org/10.1109/ICALT.2003.1215056.
Novak, E., Razzouk, R., & Johnson, T. E. (2012). The educational use of social annotation tools in higher
education: A literature review. The Internet and Higher Education, 15(1), 39-49. doi: https://doi.
org/10.1016/j.iheduc.2011.09.002.
Nunes, B. P., Kawase, R., Dietze, S., de Campos, G. H. B., & Nejdl, W. (2012). Annotation tool for
enhancing e-learning courses. In International Conference on Web-Based Learning pp. 51-60.
Springer, Berlin, Heidelberg. doi: https://doi.org/10.1007/978-3-642-33642-3_6
OEIT - MIT (2019) https://oeit.mit.edu/category/keywords/pdf/index.html
Shaked, H., Schechter, C., & Michalsky, T. (2018). Collaborative learning from personal cases in a principal
preparation programme. International Journal of Leadership in Education, 21(4), 479-490. doi:
https://doi.org/10.1080/13603124.2016.1151942.
Sun, Y., & Gao, F. (2017). Comparing the use of a social annotation tool and a threaded discussion forum
to support online discussions. The Internet and Higher Education, 32, 72-79. doi: 10.1016/j.
iheduc.2016.10.001
Tezci, E. (2009). Teachers’ effect on ICT use in education: The Turkey sample. Procedia-Social and Behavioral
Sciences, 1(1), 1285-1294. doi: https://doi.org/10.1016/j.sbspro.2009.01.228.
Wright, L. K., Zyto, S., Karger, D. R., & Newman, D. L. (2013). Online Reading Informs Classroom
Instruction and Promotes Collaborative Learning. Journal of College Science Teaching, 43(2),
44-53.
177
Yang, X., Yu, S., & Sun, Z. (2013). The effect of collaborative annotation on Chinese reading level in
primary schools in China. British Journal of Educational Technology, 44(1), 95-111. doi: https://
doi.org/10.1111/j.1467-8535.2011.01277.x
Yeh, H. C., Hung, H. T., & Chiang, Y. H. (2017). The use of online annotations in reading instruction and
its impact on students’ reading progress and processes. ReCALL, 29(1), 22-38. doi: https://doi.
org/10.1017/S0958344016000021.
Yeh, S. W., & Lo, J. J. (2009). Using online annotations to support error correction and corrective feedback.
Computers & Education, 52(4), 882-892. doi: https://doi.org/10.1016/j.compedu.2008.12.014.
Zyto, S., Karger, D., Ackerman, M., & Mahajan, S. (2012). Successful classroom deployment of a social
document annotation system. In Proceedings of the SIGCHI Conference on Human Factors in
Computing Systems (pp. 1883-1892). ACM. doi: https://doi.org/10.1145/2207676.2208326.