Research Article
BibTex RIS Cite

Assuring quality in online learning

Year 2021, Volume: 4 Issue: 4 - ICETOL Special Issue, 546 - 561, 31.12.2021
https://doi.org/10.31681/jetol.1019257

Abstract

The pervasive nature of online learning worldwide necessitates the creation, administration, and improvement of quality assurance mechanisms for higher education institutions. This article delineates a number of principles regarding features of high quality online learning systems and principles related to assessment of student learning, teacher quality measurements, and course and program evaluations. An overview of select world-leading online learning universities, leading standards for online learning systems, some important players providing services regarding online learning and quality assurance, and an extensive further reading list are provided.

References

  • AERA, APA, NCME (2014). Standards for educational and psychological testing. American Educational Research Association.
  • Ali, M. B., & Wood-Harper, A. T., Eds. (2021). Fostering communication and learning with underutilized technologies in higher education. Information Science Reference, IGI Global.
  • Banta, T. W., & Palomba, C. A. (2014). Assessment essentials: Planning, implementing, and improving assessment in higher education. Jossey-Bass, 2e.
  • Barkley, E. F., & Major, C. H. (2016). Learning assessment techniques: A handbook for college faculty. Jossey-Bass.
  • Bishop, M. J., Boling, E., Elen, J., & Svihla, V. Eds. (2020). Handbook of research in educational communication and technology: Learning design. AECT and Springer, 5e.
  • Boettcher, J. V. (2021). The online teaching survival guide. Jossey-Bass, 3e.
  • Bordoloi, R., & Das, P., Eds. (2021). Open higher education in the 21st century. Nova Science Publishers.
  • Bosch, C., Laubscher, D. J., & Kyei-Blankson, L. (2021). Re-envisioning and restructuring blended learning for underprivileged communities. IGI Global.
  • Careaga Butter, M., Aguilera, M. E., Quintana, G. B., Pérez, J. L., & Sepúlveda, V. E. (2017). Quality assurance for postgraduate programs: Design of a model applied on a university in Chile. The International Review of Research in Open and Distributed Learning, 18(1), 267-292.
  • Cifuentes, L. (2021). A guide to administering distance learning. Brill.
  • Conceição, S. C. O., & Howles, L. L. (2021). Designing the online learning experience: Evidence-based principles and strategies. Stylus Publishing.
  • Conrad, D., & Openo, J. (2018). Assessment strategies for online learning: Engagement and authenticity. Athabasca University Press.
  • Council for the Advancement of Standards in Higher Education (2019). CAS professional standards for higher education. 10e.
  • Davis, V., Dowd, C., Poulin, R., & Silverman, D. (2020). Pursuing regulatory compliance for digital instruction in response to Covid-19: Policy playbook. Every Learner Everywhere. Retrieved from https://www.everylearnereverywhere.org/Resources/.
  • Dick, E. (2021). The promise of immersive learning: Augmented and virtual reality’s potential in education. ITIF – Information Technology & Innovation Foundation.
  • Digital Learning Collaborative (2019a). Planning for quality: A guide for continuous improvement of digital learning programs. Keeping pace with digital learning report. Retrieved from https://www.digitallearningcollab.com.
  • Digital Learning Collaborative (2019b). Planning for quality: A guide for starting and growing a digital learning program. Keeping pace with digital learning report. Retrieved from https://www.digitallearningcollab.com.
  • Digital Learning Collaborative (2020). SNAPSHOT 2020: A review of K-12 online, blended and digital learning. Retrieved from https://www.digitallearningcollab.com.
  • Espino-Román, P., Olaguez-Torres, E., & Inzunza-Moraila, R. M., Eds. (2021). Developing e-assessment tools and technologies in higher education. Information Science Reference, IGI Global.
  • European University Association (2021). Universities without walls: A vision for 2030. Author.
  • Fawns, T., Aitken, G., & Jones, D., Eds. (2021). Online postgraduate education in a postdigital world: Beyond technology. Springer.
  • Forss, K., Lindkvist, I., & McGillivray, M., Eds. (2021). Long term perspectives in evaluation: Increasing relevance and utility. Routledge. Foster, B. L., Donaldson, J. F., & Graham, S. W., Eds. (2021). Paths to the future of higher education. Information Age Publishing.
  • Giancola, S. P. (2021). Program evaluation: Embedding evaluation into program design and development. SAGE Publications.
  • Glazier, R. A. (2021). Connecting in the online classroom: Building rapport between teachers & students. Johns Hopkins University Press (December).
  • Gunder, A., Vignare, K., Adams, S., McGuire, A., & Rafferty, J. (2021). Optimizing high-quality digital learning experiences: A playbook for faculty. Every Learner Everywhere. Retrieved from https://www.everylearnereverywhere.org/resources/.
  • Heller, R. F. (2022). The distributed university of sustainable higher education. Springer (appearing December 2021).
  • Hoffman, J., & Blessinger, P., Eds. (2021). International perspectives in online instruction. Volume 40. Emerald Publishing.
  • Hoidn, S., & Klemenčič, M., Eds. (2021). The Routledge handbook of student-centered learning and teaching in higher education. Routledge.
  • ICDE Working Group (2019). The present and future of alternative digital credentials (ADCs). Report of the ICDE Working Group. International Council for Open and Distance Education.
  • Johnson, D., López, Eds. (2021). The Wiley handbook of collaborative online learning and global engagement. Wiley Blackwell (November).
  • Joosten, T., Weber, N., Baker, M., Schletzbaum, A., & McGuire, A. (2021). Planning for a blended future: A research-driven guide for educators. [Report]. Every Learner Everywhere Network. Retrieved from https://www.everylelarnereverywhere.org/resources/.
  • Jørgensen, T. E., & Claeys-Kulik, A-L. (2021). Pathways to the future: A follow-up to “Universities without walls – A vision for 2030.” European University Association.
  • Jung, I., Latchem, C. R., & Herrington, J., Eds. (2012). Quality assurance and accreditation in distance education and e-learning: Models, policies, and research. Routledge.
  • Kilman, R. P., & Cook, J. R. (2021). The practice of evaluation: Partnership approaches for community change. SAGE Publications.
  • King, J. A. (2021). The American Evaluation Association’s program evaluation competencies. New Directions for Evaluation, No. 168. Wiley Periodicals.
  • Kosslyn, S. M. (2020). Active learning online: Five principles that make online courses come alive. Alinea Learning.
  • Magd, H., & Kunjumuhammed, S. K., Eds. (2022). Global perspectives on quality assurance and accreditation in higher education institutions. Information Science Reference, IGI Global.
  • Mansell, S., & Gravells, Ann (2021). 50 quality improvement & quality assurance approaches. Simple, easy, and effective ways to improve performance. Learning Matters, a SAGE company.
  • Marciniak, R. (2016). Autoevaluación de programas de educación universitaria virtual. [Self-assessment of virtual higher education programs.] Doctoral dissertation. Autonomous University of Barcelona, Spain.
  • Marciniak, R. (2018). Quality assurance for online higher education programmes: Design validation of an integrative assessment model applicable to Spanish universities. The International Review of Research in Open and Distributed Learning, 19(2), 126-154.
  • Mathes, J. (2018). Global quality in online, open, flexible and technology enhanced education: An analysis of strengths, weaknesses, opportunities, and threats. International Council for Open and Distance Education. Merriam, S. B., & Baumgartner, L. M. (2020). Learning in adulthood: A comprehensive guide. Jossey-Bass.
  • Niemi, D., Pea, R. D., Saxberg, B., & Clark, R. E., Eds. (2018). Learning analytics in education. Information Age Publishing.
  • Nilson, L. B., & Goodson, L. A. (2021). Online teaching at its best. Jossey-Bass, 2e.
  • Nolan, S. A., Hakala, C., & Landrum, R. E. (2021). Assessing undergraduate learning in psychology: Strategies for measuring and improving student performance. American Psychological Association.
  • Office of Inspector General, U.S. Department of Education (2014). Title IV of the higher education act programs: Additional safeguards are needed to help mitigate the risks that are unique to the distance education environment. Final audit report. ED-OIG/A071.001, February.
  • Palenberg, M., & Paulson, A. (2021). The realpolitik of evaluation: Why demand and supply rarely intersect. Routledge.
  • Parchoma, G., Power, M., & Lock, J., Eds. (2020). The finest blend: Graduate education in Canada. Issues in Distance Education. Athabasca University Press.
  • Peck, A., & DeSawal, D. M., Eds. (2021). Applying design thinking to the measurement of experiential learning. Information Science Reference, IGI Global.
  • Pelletier, K., Brown, M., Brooks, D. C., McCormack, M., Reeves, J., & Arbino, N. (2021). 2021 EDUCAUSE Horizon Report, Teaching and Learning Edition. EDUCAUSE.
  • Piña, A. A., Ed. (2017). Instructional design standards for distance learning. AECT – the Association for Educational Communications and Technology.
  • Quality Matters (2018). Quality matters higher education rubric (6th edition). Quality Matters.
  • https://www.qualitymatters.org/sites/default/files/PDFs/standardsfromtheQMHigher EducationRubric.pdf.
  • Rienties, B., Hampel, R., Scanlon, E., & Whitelock, D., Eds. (2021). Open-world learning: Research, innovation and the challenges of high-quality education. Routledge (December).
  • Roberts, D. M., Biddix, J. P. (2021). Frameworks for assessing learning and development outcomes. Council for the Advancement of Standards in Higher Education.
  • Schwegler, A. F. (2019a). Academic rigor: A comprehensive definition. Part one of a three-part series. Quality Matters. September 12, 2019.
  • Schwegler, A. F. (2019b). Contextualizing academic rigor. Part two of a three-part series. Quality Matters. October 11, 2019.
  • Schwegler, A. F. (2019c). Aligning institutional processes to support academic rigor. Part three of a three-part series. Quality Matters. October 25, 2019.
  • Secolsky, C., & Denison, D. B., Eds. (2017). Handbook on measurement, assessment, and evaluation in higher education. Routledge, 2e.
  • Sengupta, E., Blessiner, P., Ssemwanga, S. A., & Cozza, B., Eds. (2021). The role of external examining in higher education: Challenges and best practices. Emerald Publishing.
  • Shah, M., Richardson, J. T. E., Pabel, A., & Oliver, B., Eds. (2021). Assessing and enhancing student experience in higher education. Palgrave Macmillan.
  • Tanaka, M., Ed. (2011/2019). Student engagement and quality assurance in higher education: International collaboration for the enhancement of learning. Routledge.
  • Tertiary Education and Quality Standards Agency (2017). Quality assurance of online learning toolkit. Department of Education and Training, Australian Government. September.
  • Thomas, V. G., & Campbell, P. B. (2021). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. SAGE Publications.
  • Ubell, R. (2021). Staying online: How to navigate digital higher education. Routledge.
  • Vlachopoulos, D. (2016). Assuring quality in online course design: The roadmap. The International Review of Research in Open and Distance Learning, 17(6), 183-205.
  • Waldrop, D., Reschly, A. L., Fraysler, K., & Appleton, J. J. (2019). Measuring the engagement of college students: Administration format, structure, and validity of the student engagement instrument – college. Measurement and Evaluation in Counseling and Development, 51(2), 90-107. https://doi.org/10.1080/07481756.2018.14972129.
  • Web Accessibility Initiative of the Worldwide Web Consortium (2021). Why standards harmonization is essential to web accessibility. https://w3.org/WAI/standards-guidelines/harmonization. Retrieved 07.30.2021.
  • Xu, D., & Xu, Y. (2019). The promises and limits of online higher education: Understanding how distance education affects access, cost, and quality. American Enterprise Institute (AEI), March.
  • Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2010). The program evaluation standards: A guide for evaluators and evaluation users. Joint Committee on Standards for Educational Evaluation. SAGE, 3e.
  • Zhoc, K. C. H., Webster, B. J., King, R. B., Li, J. C. H., & Chung, T. S. H. (2018). Higher education student engagement scale (HESES): Development and psychometric evidence. Research in Higher Education, 60(2), 219-244. https://doi.org/10.1007/s11162-018-9510-6.
Year 2021, Volume: 4 Issue: 4 - ICETOL Special Issue, 546 - 561, 31.12.2021
https://doi.org/10.31681/jetol.1019257

Abstract

References

  • AERA, APA, NCME (2014). Standards for educational and psychological testing. American Educational Research Association.
  • Ali, M. B., & Wood-Harper, A. T., Eds. (2021). Fostering communication and learning with underutilized technologies in higher education. Information Science Reference, IGI Global.
  • Banta, T. W., & Palomba, C. A. (2014). Assessment essentials: Planning, implementing, and improving assessment in higher education. Jossey-Bass, 2e.
  • Barkley, E. F., & Major, C. H. (2016). Learning assessment techniques: A handbook for college faculty. Jossey-Bass.
  • Bishop, M. J., Boling, E., Elen, J., & Svihla, V. Eds. (2020). Handbook of research in educational communication and technology: Learning design. AECT and Springer, 5e.
  • Boettcher, J. V. (2021). The online teaching survival guide. Jossey-Bass, 3e.
  • Bordoloi, R., & Das, P., Eds. (2021). Open higher education in the 21st century. Nova Science Publishers.
  • Bosch, C., Laubscher, D. J., & Kyei-Blankson, L. (2021). Re-envisioning and restructuring blended learning for underprivileged communities. IGI Global.
  • Careaga Butter, M., Aguilera, M. E., Quintana, G. B., Pérez, J. L., & Sepúlveda, V. E. (2017). Quality assurance for postgraduate programs: Design of a model applied on a university in Chile. The International Review of Research in Open and Distributed Learning, 18(1), 267-292.
  • Cifuentes, L. (2021). A guide to administering distance learning. Brill.
  • Conceição, S. C. O., & Howles, L. L. (2021). Designing the online learning experience: Evidence-based principles and strategies. Stylus Publishing.
  • Conrad, D., & Openo, J. (2018). Assessment strategies for online learning: Engagement and authenticity. Athabasca University Press.
  • Council for the Advancement of Standards in Higher Education (2019). CAS professional standards for higher education. 10e.
  • Davis, V., Dowd, C., Poulin, R., & Silverman, D. (2020). Pursuing regulatory compliance for digital instruction in response to Covid-19: Policy playbook. Every Learner Everywhere. Retrieved from https://www.everylearnereverywhere.org/Resources/.
  • Dick, E. (2021). The promise of immersive learning: Augmented and virtual reality’s potential in education. ITIF – Information Technology & Innovation Foundation.
  • Digital Learning Collaborative (2019a). Planning for quality: A guide for continuous improvement of digital learning programs. Keeping pace with digital learning report. Retrieved from https://www.digitallearningcollab.com.
  • Digital Learning Collaborative (2019b). Planning for quality: A guide for starting and growing a digital learning program. Keeping pace with digital learning report. Retrieved from https://www.digitallearningcollab.com.
  • Digital Learning Collaborative (2020). SNAPSHOT 2020: A review of K-12 online, blended and digital learning. Retrieved from https://www.digitallearningcollab.com.
  • Espino-Román, P., Olaguez-Torres, E., & Inzunza-Moraila, R. M., Eds. (2021). Developing e-assessment tools and technologies in higher education. Information Science Reference, IGI Global.
  • European University Association (2021). Universities without walls: A vision for 2030. Author.
  • Fawns, T., Aitken, G., & Jones, D., Eds. (2021). Online postgraduate education in a postdigital world: Beyond technology. Springer.
  • Forss, K., Lindkvist, I., & McGillivray, M., Eds. (2021). Long term perspectives in evaluation: Increasing relevance and utility. Routledge. Foster, B. L., Donaldson, J. F., & Graham, S. W., Eds. (2021). Paths to the future of higher education. Information Age Publishing.
  • Giancola, S. P. (2021). Program evaluation: Embedding evaluation into program design and development. SAGE Publications.
  • Glazier, R. A. (2021). Connecting in the online classroom: Building rapport between teachers & students. Johns Hopkins University Press (December).
  • Gunder, A., Vignare, K., Adams, S., McGuire, A., & Rafferty, J. (2021). Optimizing high-quality digital learning experiences: A playbook for faculty. Every Learner Everywhere. Retrieved from https://www.everylearnereverywhere.org/resources/.
  • Heller, R. F. (2022). The distributed university of sustainable higher education. Springer (appearing December 2021).
  • Hoffman, J., & Blessinger, P., Eds. (2021). International perspectives in online instruction. Volume 40. Emerald Publishing.
  • Hoidn, S., & Klemenčič, M., Eds. (2021). The Routledge handbook of student-centered learning and teaching in higher education. Routledge.
  • ICDE Working Group (2019). The present and future of alternative digital credentials (ADCs). Report of the ICDE Working Group. International Council for Open and Distance Education.
  • Johnson, D., López, Eds. (2021). The Wiley handbook of collaborative online learning and global engagement. Wiley Blackwell (November).
  • Joosten, T., Weber, N., Baker, M., Schletzbaum, A., & McGuire, A. (2021). Planning for a blended future: A research-driven guide for educators. [Report]. Every Learner Everywhere Network. Retrieved from https://www.everylelarnereverywhere.org/resources/.
  • Jørgensen, T. E., & Claeys-Kulik, A-L. (2021). Pathways to the future: A follow-up to “Universities without walls – A vision for 2030.” European University Association.
  • Jung, I., Latchem, C. R., & Herrington, J., Eds. (2012). Quality assurance and accreditation in distance education and e-learning: Models, policies, and research. Routledge.
  • Kilman, R. P., & Cook, J. R. (2021). The practice of evaluation: Partnership approaches for community change. SAGE Publications.
  • King, J. A. (2021). The American Evaluation Association’s program evaluation competencies. New Directions for Evaluation, No. 168. Wiley Periodicals.
  • Kosslyn, S. M. (2020). Active learning online: Five principles that make online courses come alive. Alinea Learning.
  • Magd, H., & Kunjumuhammed, S. K., Eds. (2022). Global perspectives on quality assurance and accreditation in higher education institutions. Information Science Reference, IGI Global.
  • Mansell, S., & Gravells, Ann (2021). 50 quality improvement & quality assurance approaches. Simple, easy, and effective ways to improve performance. Learning Matters, a SAGE company.
  • Marciniak, R. (2016). Autoevaluación de programas de educación universitaria virtual. [Self-assessment of virtual higher education programs.] Doctoral dissertation. Autonomous University of Barcelona, Spain.
  • Marciniak, R. (2018). Quality assurance for online higher education programmes: Design validation of an integrative assessment model applicable to Spanish universities. The International Review of Research in Open and Distributed Learning, 19(2), 126-154.
  • Mathes, J. (2018). Global quality in online, open, flexible and technology enhanced education: An analysis of strengths, weaknesses, opportunities, and threats. International Council for Open and Distance Education. Merriam, S. B., & Baumgartner, L. M. (2020). Learning in adulthood: A comprehensive guide. Jossey-Bass.
  • Niemi, D., Pea, R. D., Saxberg, B., & Clark, R. E., Eds. (2018). Learning analytics in education. Information Age Publishing.
  • Nilson, L. B., & Goodson, L. A. (2021). Online teaching at its best. Jossey-Bass, 2e.
  • Nolan, S. A., Hakala, C., & Landrum, R. E. (2021). Assessing undergraduate learning in psychology: Strategies for measuring and improving student performance. American Psychological Association.
  • Office of Inspector General, U.S. Department of Education (2014). Title IV of the higher education act programs: Additional safeguards are needed to help mitigate the risks that are unique to the distance education environment. Final audit report. ED-OIG/A071.001, February.
  • Palenberg, M., & Paulson, A. (2021). The realpolitik of evaluation: Why demand and supply rarely intersect. Routledge.
  • Parchoma, G., Power, M., & Lock, J., Eds. (2020). The finest blend: Graduate education in Canada. Issues in Distance Education. Athabasca University Press.
  • Peck, A., & DeSawal, D. M., Eds. (2021). Applying design thinking to the measurement of experiential learning. Information Science Reference, IGI Global.
  • Pelletier, K., Brown, M., Brooks, D. C., McCormack, M., Reeves, J., & Arbino, N. (2021). 2021 EDUCAUSE Horizon Report, Teaching and Learning Edition. EDUCAUSE.
  • Piña, A. A., Ed. (2017). Instructional design standards for distance learning. AECT – the Association for Educational Communications and Technology.
  • Quality Matters (2018). Quality matters higher education rubric (6th edition). Quality Matters.
  • https://www.qualitymatters.org/sites/default/files/PDFs/standardsfromtheQMHigher EducationRubric.pdf.
  • Rienties, B., Hampel, R., Scanlon, E., & Whitelock, D., Eds. (2021). Open-world learning: Research, innovation and the challenges of high-quality education. Routledge (December).
  • Roberts, D. M., Biddix, J. P. (2021). Frameworks for assessing learning and development outcomes. Council for the Advancement of Standards in Higher Education.
  • Schwegler, A. F. (2019a). Academic rigor: A comprehensive definition. Part one of a three-part series. Quality Matters. September 12, 2019.
  • Schwegler, A. F. (2019b). Contextualizing academic rigor. Part two of a three-part series. Quality Matters. October 11, 2019.
  • Schwegler, A. F. (2019c). Aligning institutional processes to support academic rigor. Part three of a three-part series. Quality Matters. October 25, 2019.
  • Secolsky, C., & Denison, D. B., Eds. (2017). Handbook on measurement, assessment, and evaluation in higher education. Routledge, 2e.
  • Sengupta, E., Blessiner, P., Ssemwanga, S. A., & Cozza, B., Eds. (2021). The role of external examining in higher education: Challenges and best practices. Emerald Publishing.
  • Shah, M., Richardson, J. T. E., Pabel, A., & Oliver, B., Eds. (2021). Assessing and enhancing student experience in higher education. Palgrave Macmillan.
  • Tanaka, M., Ed. (2011/2019). Student engagement and quality assurance in higher education: International collaboration for the enhancement of learning. Routledge.
  • Tertiary Education and Quality Standards Agency (2017). Quality assurance of online learning toolkit. Department of Education and Training, Australian Government. September.
  • Thomas, V. G., & Campbell, P. B. (2021). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. SAGE Publications.
  • Ubell, R. (2021). Staying online: How to navigate digital higher education. Routledge.
  • Vlachopoulos, D. (2016). Assuring quality in online course design: The roadmap. The International Review of Research in Open and Distance Learning, 17(6), 183-205.
  • Waldrop, D., Reschly, A. L., Fraysler, K., & Appleton, J. J. (2019). Measuring the engagement of college students: Administration format, structure, and validity of the student engagement instrument – college. Measurement and Evaluation in Counseling and Development, 51(2), 90-107. https://doi.org/10.1080/07481756.2018.14972129.
  • Web Accessibility Initiative of the Worldwide Web Consortium (2021). Why standards harmonization is essential to web accessibility. https://w3.org/WAI/standards-guidelines/harmonization. Retrieved 07.30.2021.
  • Xu, D., & Xu, Y. (2019). The promises and limits of online higher education: Understanding how distance education affects access, cost, and quality. American Enterprise Institute (AEI), March.
  • Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2010). The program evaluation standards: A guide for evaluators and evaluation users. Joint Committee on Standards for Educational Evaluation. SAGE, 3e.
  • Zhoc, K. C. H., Webster, B. J., King, R. B., Li, J. C. H., & Chung, T. S. H. (2018). Higher education student engagement scale (HESES): Development and psychometric evidence. Research in Higher Education, 60(2), 219-244. https://doi.org/10.1007/s11162-018-9510-6.
There are 70 citations in total.

Details

Primary Language English
Subjects Studies on Education
Journal Section Articles
Authors

Dennis Cheek 0000-0003-0008-9810

Publication Date December 31, 2021
Published in Issue Year 2021 Volume: 4 Issue: 4 - ICETOL Special Issue

Cite

APA Cheek, D. (2021). Assuring quality in online learning. Journal of Educational Technology and Online Learning, 4(4), 546-561. https://doi.org/10.31681/jetol.1019257


22029

JETOL is abstracted and indexed by ERIC - Education Resources Information Center.