Report
BibTex RIS Cite

An Application of Personalized Adaptive Learning Systems in Calculus I Course

Year 2022, Volume: 7 Issue: 2, 307 - 321, 06.07.2022
https://doi.org/10.53850/joltida.1116403

Abstract

Since Personalized Instruction increases the motivation, interest, performance and attitude of the student, it is aimed to develop an instructional management system that can be adapted to the individual, taking into account the prior knowledge level of the person who provides the personalization of all instructional materials. The project is basically an interdisciplinary system and product development study covering the fields of educational technology and computer engineering. The research, which was planned as a research and development study, was generally planned in accordance with action research methodologies. Considered within the scope of "Information Access and Management Systems", a learning management system that can be adapted to the individual has been developed with this project. In the system, a database has been created in which students are better introduced. An adaptation of the mathematics course was made as an example given by Arizona State University.

Project Number

1059B191500045 Proje Başvuru numarası

References

  • Ahn, J., & Brusilovsky, P. (2007). From User Query to User Model and Back: Adaptive Relevance-Based Visualization for Information Foraging. IEEE/WIC/ACM International Conference on Web Intelligence.
  • Bates, E. T and Wiest, L. R. (2004) Impact of Personalization of Mathematical Word Problems on Student Performance. The Mathematics Educator, 14 (2), 17–26.
  • Bober, M., Šaloun, P. ve Velart, Z.( 2007) Knowledge mining from adaptive course. Conference Proceedings from 5th International Conference on Emerging e-Learning Technologies and Applications - ICETA 2007.
  • Brusilovsky, P. & Yudelson, M. V. (2008). From WebEx to NavEx: Interactive Access to Annotated Program Examples. Proceedings of the IEEE | Vol. 96, No. 6
  • Brusilovsky, P. (1998). “Methods and Techniques of Adaptive Hypermedia”, Adaptive Hypertext and Hypermedia Editorler: P. Brusilovsky, A. Kobsa, J. Vassileva, Boston: Kluwer Academic Publishers, 1-44.
  • Brusilovsky, P. (2001). Adaptive Hypermedia. User Modeling and User-Adapted Interaction 11: 87^110, 2001. 87 # 2001. Netherlands.
  • Brusilovsky, P., Ahn, J., Dumitriu, T & Yudelson, M. (2006). Adaptive Knowledge-Based Visualization for Accessing Educational Examples. Proceedings of the Information Visualization (IV’06) 0-7695-2602-0/06.
  • Brusilovsky, P., Eklund, J. & Schwarz, E. (1998). Web-based Education for All: A Tool for Development Adaptive Courseware. Computer Networks and ISDN Systems (Proceedings of Seventh International World Wide Web Conference, 14-18 April 1998) 30 (1-7), 291-300.
  • Brusilovsky, Peter (2001) Adaptive Hypermedia. User Modeling and User-Adapted Interaction 11: 87-110, 2001. 87
  • Brusilovsky,P. (2003). “Adaptive Navigation Support in Educational Hypermedia: The Role of Student Knowledge Level And The Case For Meta-Adaptation”, British Journal of Educational Technology, 34(4), 487-497.
  • Çakır Balta, Ö. (2008). Bilgisayar ve Sınıf Ortamında Kişiselleştirilmiş Sözel Matematik Problemlerini Kullanmanın Öğrenci Başarısına Etkisi. Ankara Üniversitesi, Eğitim Bilimleri Enstitüsü, Bilgisayar ve Öğretim Teknolojileri Eğitimi Ana Bilim Dalı, Eğitim Teknolojisi Programı, Ankara.
  • Chen, C.J, and Liu, P.L. (2007) Personalized Computer-Assisted Mathematics Problem-Solving Program and Its Impact on Taiwanese Students. Journal of Computers in Mathematics and Science Teaching, 26 (2), 105 -121.
  • Chieu, Vu Minh (2005). Constructivist Learning: An Operational Approach for Designing Adaptive Learning Environments Supporting Cognitive Flexibility. Thèse présentée en vue de l'obtention du grade de Docteur en Sciences Appliquées. Université catholique de Louvain, Faculté des Sciences Appliqués, Département d'Ingénierie Informatique.
  • Cordova, D. I. (1993). The Effects of Personalization and Choice on Students' Intrinsic Motivation and Learning. Unpublished PHD, Stanford University (0212). Center for Positive Structures web sitesindeki http://www.positivepractices.com/Personal /PersonalizationAbstracts.html adresinden 04.12.2005’te alınmıştır.
  • Cordova, D.I., and Lepper, M.R. (1996). Intrinsic Motivation and the Process of Learning: Beneficial Effects of Contextualization, Personalization, and Choice. Journal of Educational Psychology, 88 (4), 715–730.
  • Dağ, Funda (2003). Zeki Öğretim Sistemi Bileşenlerinin Prolog ile Gerçekleştirilmesi, Yüksek Lisans Tezi. Kocaeli Üniversitesi, Fen Bilimleri Enstitüsü. Kocaeli.
  • d'Ailly, H.H., Simpson, J., and MacKinnon, G.E. (1997). Where Should "You" Go in a Math Compare Problem? Journal of Educational Psychology, 89, 562-567.
  • Davis-Dorsey, J., Ross, S.M., and Morrison, G.R. (1991). The Role of Rewording and Context Personalization in the Solving of Mathematical Word Problems. Journal of Educational Psychology, 83 (1), 61-68.
  • Demirören, S. (2014). Başarım Ölçütlü Uyarlanabilir Öğrenmenin Etkililiğinin Ve Verimliliğinin Değerlendirilmesi. Ankara Üniversitesi, Eğitim Bilimleri Enstitüsü, Bilgisayar ve Öğretim Teknolojileri Eğitimi Ana Bilim Dalı, Eğitim Teknolojisi Programı, Ankara.
  • Diack, A. (2004). Innovation and Personalised Learning. Education Review, 18 (1), 49-55. Eklund, J. & Brusilovsky, P. (1999). “InterBook: An Adaptive Tutoring System”, UniServe Science News, 12, 8-13.
  • Eryılmaz,M. ve Şimşek,N. (2014). Uyarlanabilir Ortamlarda Öğrenci Başarısının Değerlendirilmesi. Eğitim ve Bilim, 39 (173).
  • Grigoriadou, M., Papanikolaou, K., Kornilakis, H. & Magoulas, G. ().An Intelligent System for Personalized Instruction in a Remote Environment Hart, J. M. (1996). The Effect of Personalized Word Problems. Teaching Children Mathematics, 2 (8), 504- 505.
  • Herder, E. (2006). “Forward, Back and Home Again Analyzing User Behavior on the Web”, Doktora Tezi, University of Twente.
  • Herndon, J. N. (1988). Achievement and Continuing Motivation Under Differing Levels of Personalized Instruction. Unpublished PHD, Arizona State University. Center for Positive Structures web sitesindeki http://www.positivepractices.com/Personal /PersonalizationAbstracts.html adresinden 04.12.2005’te alınmıştır.
  • Horzum, M. & Çakır, Ö. (2009). Çevrim İçi Teknolojilere Yönelik Öz Yeterlik Algısı Ölçeği Türkçe Formunun Geçerlik ve Güvenirlik Çalışması. Kuram ve Uygulamada Eğitim Bilimleri / Educational Sciences: Theory & Practice 9 (3), 1327-1356
  • Jameson, A. (2003). “Adaptive Interfaces and Agents”, Human-Computer Interaction Handbook, Editorler: J. A. Jacko, A. Sears, Mahwah, NJ: Erlbaum, 305-330.
  • Kaplan, C., Fenwick, J. & Chen, J: (1998). “Adaptive Hypertext Navigation Based on User Goals and Context”, Adaptive Hypertext and Hypermedia, Editorler: P. Brusilovsky, A. Kobsa, J. Vassileva, Boston: Kluwer Academic Publishers, 1-44. Keefe, J. W. (2007). “What is Personalization?”. Phi Delta Kapan International
  • Knapp, J., Gamper, J. & Brusilovsky, P. (2004). Multiple Use of Content in a Web-Based Language Learning System. Proceedings of the IEEE International Conference on Advanced Learning Technologies (ICALT’04) 0-7695-2181-9/04.
  • Ku, H. Y., and Sullivan, H. J. (2002). Student Performance and Attitudes Using Personalized Mathematics Instruction. Educational Technology Research and Development, 50 (1), 21–34.
  • Ku, H.-Y., and Sullivan, H.J. (2000). Personalization of Mathematics Word Problems in Taiwan. Educational Technology Research and Development, 48 (3),49-59.
  • Ku, H.-Y., Harter, C. A., Liu, P.-L., Thompson, L., and Cheng, Y.-C. (2007). The Effects of Individually Personalized Computer-Based Instructional Program on Solving Mathematics Problems. Computers in Human Behavior, 23, 1195-1210.
  • Ku, H-Y, Harter, C., Liu, P-L., Cheng, Y-C., and Yang, L. (2004). The Effects of Using Personalized Computer-Based Instruction in Mathematics Learning. National Educational Computing Conference (NECC), New Orleans, LA.
  • Lee, D. H. & Brusilovsky, P. (2007). Fighting Information Overflow with Personalized Comprehensive Information Access: A Proactive Job Recommender. Third International Conference on Autonomic and Autonomous Systems (ICAS 2007) 0-7695-2859-5/07.
  • Lopez, C.L., and Sullivan, H.J. (1992). Effect of Personalization of Instructional Context on the Achievement and Attitudes of Hispanic Students. Educational Technology Research and Development, 40 (4), 5-13.
  • Maria Grigoriadou, Kyparisia Papanikolaou, Harry Kornilakis, George Magoulas ( ) . Adaptive Educational Hypermedia System, named INSPIRE.
  • Morrison, G. R., Ross, S. M., and Baldwin, W. (1992). Learner Control of Context and Instructional Support in Learning Elementary School Mathematics. Educational Technology, Research and Development, 40, 5–13.
  • Nakabayashi, K. , Maruyama, M., Koike, Y., Kato, Y. Touhei, H. & Fukuhara, Y. (1997). Architecture of an Intelligent Tutoring System on the WWW. Proceedings of the 8th World Conference of the AIED Society, Kobe, Japan, 18-22 August 1997
  • P. D. Bra, “Adaptive Hypermedia on the Web: Methods, techniques and applications”, Proceeedings of the AACE WebNet'98, AACE, Orlando, Fl, 220-225, 1998.
  • Ross, S.M., McCormick, D., Krisak, N., and Anand, P.G. (1985). Personalizing Context in Teaching Mathematical Concepts: Teacher-Managed and Computer-Assisted Models. Educational Communication and Technology Journal, 33 (3), 169-178.
  • Şimşek, N. & Çakır, Ö. (2009). Effect of Personalization on Students' Achievement and Gender Factor in Mathematics Education. International Journal of Social Sciences 4(4), 278-282
  • Şimşek, N. (1998). Öğretim amaçlı bilgisayar yazılımlarının değerlendirilmesi: Kavramlar, teknikler, araçlar ve uygulama. Ankara: Siyasal Kitabevi, 1998
  • Somyürek, S. (2008). Uyarlanabilir Eğitsel Web Ortamlarının Öğrencilerin Akademik Başarısına ve Gezinmesine Etkisi. Doktora tezi. Gazi Üniversitesi. Eğitim Bilimleri Enstitüsü
  • Somyürek, S. (2009). Uyarlanabilir Öğrenme Ortamları: Eğitsel Hiper Ortam Tasarımında Yeni Bir Paradigma. Bilişim Teknolojileri Dergisi. 2(1). 29-38.
  • Somyürek, S. ve Atasoy, B. (2008). Gezinme Adaptasyonu: Neden ve Nasıl?. 8th International Educational Technology Conference (IETC2008), 6-9 Mayıs 2008, Eskişehir, Türkiye.
  • Vijay K. Gurbani and Xian-He Sun and Alec Brusilovsky (2005). Inhibitors for Ubiquitous Deployment of Services in the Next-Generation Network. IEEE Communications Magazine September 2005.
  • Wongchokprasitti, C., & Brusilovsky, P. (2007). NewsMe: A Case Study for Adaptive News Systems with Open User Model. Third International Conference on Autonomic and Autonomous Systems (ICAS'07).
  • Yudelson, M., Brusilovsky, P. & Sosnovsky, S. (2004). Accessing Interactive Examples with Adaptive Navigation Support. Proceedings of the IEEE International Conference on Advanced Learning Technologies (ICALT’04) 0-7695-2181-9/04.
Year 2022, Volume: 7 Issue: 2, 307 - 321, 06.07.2022
https://doi.org/10.53850/joltida.1116403

Abstract

Supporting Institution

TUBİTAK 2219 projesi

Project Number

1059B191500045 Proje Başvuru numarası

References

  • Ahn, J., & Brusilovsky, P. (2007). From User Query to User Model and Back: Adaptive Relevance-Based Visualization for Information Foraging. IEEE/WIC/ACM International Conference on Web Intelligence.
  • Bates, E. T and Wiest, L. R. (2004) Impact of Personalization of Mathematical Word Problems on Student Performance. The Mathematics Educator, 14 (2), 17–26.
  • Bober, M., Šaloun, P. ve Velart, Z.( 2007) Knowledge mining from adaptive course. Conference Proceedings from 5th International Conference on Emerging e-Learning Technologies and Applications - ICETA 2007.
  • Brusilovsky, P. & Yudelson, M. V. (2008). From WebEx to NavEx: Interactive Access to Annotated Program Examples. Proceedings of the IEEE | Vol. 96, No. 6
  • Brusilovsky, P. (1998). “Methods and Techniques of Adaptive Hypermedia”, Adaptive Hypertext and Hypermedia Editorler: P. Brusilovsky, A. Kobsa, J. Vassileva, Boston: Kluwer Academic Publishers, 1-44.
  • Brusilovsky, P. (2001). Adaptive Hypermedia. User Modeling and User-Adapted Interaction 11: 87^110, 2001. 87 # 2001. Netherlands.
  • Brusilovsky, P., Ahn, J., Dumitriu, T & Yudelson, M. (2006). Adaptive Knowledge-Based Visualization for Accessing Educational Examples. Proceedings of the Information Visualization (IV’06) 0-7695-2602-0/06.
  • Brusilovsky, P., Eklund, J. & Schwarz, E. (1998). Web-based Education for All: A Tool for Development Adaptive Courseware. Computer Networks and ISDN Systems (Proceedings of Seventh International World Wide Web Conference, 14-18 April 1998) 30 (1-7), 291-300.
  • Brusilovsky, Peter (2001) Adaptive Hypermedia. User Modeling and User-Adapted Interaction 11: 87-110, 2001. 87
  • Brusilovsky,P. (2003). “Adaptive Navigation Support in Educational Hypermedia: The Role of Student Knowledge Level And The Case For Meta-Adaptation”, British Journal of Educational Technology, 34(4), 487-497.
  • Çakır Balta, Ö. (2008). Bilgisayar ve Sınıf Ortamında Kişiselleştirilmiş Sözel Matematik Problemlerini Kullanmanın Öğrenci Başarısına Etkisi. Ankara Üniversitesi, Eğitim Bilimleri Enstitüsü, Bilgisayar ve Öğretim Teknolojileri Eğitimi Ana Bilim Dalı, Eğitim Teknolojisi Programı, Ankara.
  • Chen, C.J, and Liu, P.L. (2007) Personalized Computer-Assisted Mathematics Problem-Solving Program and Its Impact on Taiwanese Students. Journal of Computers in Mathematics and Science Teaching, 26 (2), 105 -121.
  • Chieu, Vu Minh (2005). Constructivist Learning: An Operational Approach for Designing Adaptive Learning Environments Supporting Cognitive Flexibility. Thèse présentée en vue de l'obtention du grade de Docteur en Sciences Appliquées. Université catholique de Louvain, Faculté des Sciences Appliqués, Département d'Ingénierie Informatique.
  • Cordova, D. I. (1993). The Effects of Personalization and Choice on Students' Intrinsic Motivation and Learning. Unpublished PHD, Stanford University (0212). Center for Positive Structures web sitesindeki http://www.positivepractices.com/Personal /PersonalizationAbstracts.html adresinden 04.12.2005’te alınmıştır.
  • Cordova, D.I., and Lepper, M.R. (1996). Intrinsic Motivation and the Process of Learning: Beneficial Effects of Contextualization, Personalization, and Choice. Journal of Educational Psychology, 88 (4), 715–730.
  • Dağ, Funda (2003). Zeki Öğretim Sistemi Bileşenlerinin Prolog ile Gerçekleştirilmesi, Yüksek Lisans Tezi. Kocaeli Üniversitesi, Fen Bilimleri Enstitüsü. Kocaeli.
  • d'Ailly, H.H., Simpson, J., and MacKinnon, G.E. (1997). Where Should "You" Go in a Math Compare Problem? Journal of Educational Psychology, 89, 562-567.
  • Davis-Dorsey, J., Ross, S.M., and Morrison, G.R. (1991). The Role of Rewording and Context Personalization in the Solving of Mathematical Word Problems. Journal of Educational Psychology, 83 (1), 61-68.
  • Demirören, S. (2014). Başarım Ölçütlü Uyarlanabilir Öğrenmenin Etkililiğinin Ve Verimliliğinin Değerlendirilmesi. Ankara Üniversitesi, Eğitim Bilimleri Enstitüsü, Bilgisayar ve Öğretim Teknolojileri Eğitimi Ana Bilim Dalı, Eğitim Teknolojisi Programı, Ankara.
  • Diack, A. (2004). Innovation and Personalised Learning. Education Review, 18 (1), 49-55. Eklund, J. & Brusilovsky, P. (1999). “InterBook: An Adaptive Tutoring System”, UniServe Science News, 12, 8-13.
  • Eryılmaz,M. ve Şimşek,N. (2014). Uyarlanabilir Ortamlarda Öğrenci Başarısının Değerlendirilmesi. Eğitim ve Bilim, 39 (173).
  • Grigoriadou, M., Papanikolaou, K., Kornilakis, H. & Magoulas, G. ().An Intelligent System for Personalized Instruction in a Remote Environment Hart, J. M. (1996). The Effect of Personalized Word Problems. Teaching Children Mathematics, 2 (8), 504- 505.
  • Herder, E. (2006). “Forward, Back and Home Again Analyzing User Behavior on the Web”, Doktora Tezi, University of Twente.
  • Herndon, J. N. (1988). Achievement and Continuing Motivation Under Differing Levels of Personalized Instruction. Unpublished PHD, Arizona State University. Center for Positive Structures web sitesindeki http://www.positivepractices.com/Personal /PersonalizationAbstracts.html adresinden 04.12.2005’te alınmıştır.
  • Horzum, M. & Çakır, Ö. (2009). Çevrim İçi Teknolojilere Yönelik Öz Yeterlik Algısı Ölçeği Türkçe Formunun Geçerlik ve Güvenirlik Çalışması. Kuram ve Uygulamada Eğitim Bilimleri / Educational Sciences: Theory & Practice 9 (3), 1327-1356
  • Jameson, A. (2003). “Adaptive Interfaces and Agents”, Human-Computer Interaction Handbook, Editorler: J. A. Jacko, A. Sears, Mahwah, NJ: Erlbaum, 305-330.
  • Kaplan, C., Fenwick, J. & Chen, J: (1998). “Adaptive Hypertext Navigation Based on User Goals and Context”, Adaptive Hypertext and Hypermedia, Editorler: P. Brusilovsky, A. Kobsa, J. Vassileva, Boston: Kluwer Academic Publishers, 1-44. Keefe, J. W. (2007). “What is Personalization?”. Phi Delta Kapan International
  • Knapp, J., Gamper, J. & Brusilovsky, P. (2004). Multiple Use of Content in a Web-Based Language Learning System. Proceedings of the IEEE International Conference on Advanced Learning Technologies (ICALT’04) 0-7695-2181-9/04.
  • Ku, H. Y., and Sullivan, H. J. (2002). Student Performance and Attitudes Using Personalized Mathematics Instruction. Educational Technology Research and Development, 50 (1), 21–34.
  • Ku, H.-Y., and Sullivan, H.J. (2000). Personalization of Mathematics Word Problems in Taiwan. Educational Technology Research and Development, 48 (3),49-59.
  • Ku, H.-Y., Harter, C. A., Liu, P.-L., Thompson, L., and Cheng, Y.-C. (2007). The Effects of Individually Personalized Computer-Based Instructional Program on Solving Mathematics Problems. Computers in Human Behavior, 23, 1195-1210.
  • Ku, H-Y, Harter, C., Liu, P-L., Cheng, Y-C., and Yang, L. (2004). The Effects of Using Personalized Computer-Based Instruction in Mathematics Learning. National Educational Computing Conference (NECC), New Orleans, LA.
  • Lee, D. H. & Brusilovsky, P. (2007). Fighting Information Overflow with Personalized Comprehensive Information Access: A Proactive Job Recommender. Third International Conference on Autonomic and Autonomous Systems (ICAS 2007) 0-7695-2859-5/07.
  • Lopez, C.L., and Sullivan, H.J. (1992). Effect of Personalization of Instructional Context on the Achievement and Attitudes of Hispanic Students. Educational Technology Research and Development, 40 (4), 5-13.
  • Maria Grigoriadou, Kyparisia Papanikolaou, Harry Kornilakis, George Magoulas ( ) . Adaptive Educational Hypermedia System, named INSPIRE.
  • Morrison, G. R., Ross, S. M., and Baldwin, W. (1992). Learner Control of Context and Instructional Support in Learning Elementary School Mathematics. Educational Technology, Research and Development, 40, 5–13.
  • Nakabayashi, K. , Maruyama, M., Koike, Y., Kato, Y. Touhei, H. & Fukuhara, Y. (1997). Architecture of an Intelligent Tutoring System on the WWW. Proceedings of the 8th World Conference of the AIED Society, Kobe, Japan, 18-22 August 1997
  • P. D. Bra, “Adaptive Hypermedia on the Web: Methods, techniques and applications”, Proceeedings of the AACE WebNet'98, AACE, Orlando, Fl, 220-225, 1998.
  • Ross, S.M., McCormick, D., Krisak, N., and Anand, P.G. (1985). Personalizing Context in Teaching Mathematical Concepts: Teacher-Managed and Computer-Assisted Models. Educational Communication and Technology Journal, 33 (3), 169-178.
  • Şimşek, N. & Çakır, Ö. (2009). Effect of Personalization on Students' Achievement and Gender Factor in Mathematics Education. International Journal of Social Sciences 4(4), 278-282
  • Şimşek, N. (1998). Öğretim amaçlı bilgisayar yazılımlarının değerlendirilmesi: Kavramlar, teknikler, araçlar ve uygulama. Ankara: Siyasal Kitabevi, 1998
  • Somyürek, S. (2008). Uyarlanabilir Eğitsel Web Ortamlarının Öğrencilerin Akademik Başarısına ve Gezinmesine Etkisi. Doktora tezi. Gazi Üniversitesi. Eğitim Bilimleri Enstitüsü
  • Somyürek, S. (2009). Uyarlanabilir Öğrenme Ortamları: Eğitsel Hiper Ortam Tasarımında Yeni Bir Paradigma. Bilişim Teknolojileri Dergisi. 2(1). 29-38.
  • Somyürek, S. ve Atasoy, B. (2008). Gezinme Adaptasyonu: Neden ve Nasıl?. 8th International Educational Technology Conference (IETC2008), 6-9 Mayıs 2008, Eskişehir, Türkiye.
  • Vijay K. Gurbani and Xian-He Sun and Alec Brusilovsky (2005). Inhibitors for Ubiquitous Deployment of Services in the Next-Generation Network. IEEE Communications Magazine September 2005.
  • Wongchokprasitti, C., & Brusilovsky, P. (2007). NewsMe: A Case Study for Adaptive News Systems with Open User Model. Third International Conference on Autonomic and Autonomous Systems (ICAS'07).
  • Yudelson, M., Brusilovsky, P. & Sosnovsky, S. (2004). Accessing Interactive Examples with Adaptive Navigation Support. Proceedings of the IEEE International Conference on Advanced Learning Technologies (ICALT’04) 0-7695-2181-9/04.
There are 47 citations in total.

Details

Primary Language English
Subjects Computer Software
Journal Section Research Article
Authors

Ozlem Cakir 0000-0002-7306-5820

Project Number 1059B191500045 Proje Başvuru numarası
Publication Date July 6, 2022
Submission Date May 13, 2022
Published in Issue Year 2022 Volume: 7 Issue: 2

Cite

APA Cakir, O. (2022). An Application of Personalized Adaptive Learning Systems in Calculus I Course. Journal of Learning and Teaching in Digital Age, 7(2), 307-321. https://doi.org/10.53850/joltida.1116403

Journal of Learning and Teaching in Digital Age 2023. © 2023. This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. 19195

Journal of Learning and Teaching in Digital Age. All rights reserved, 2023. ISSN:2458-8350