Evaluation Model for Evaluating Vocational Skills Programs on Local Content Curriculum in Indonesia: Impact of Educational System in Indonesia

Year 2019, Volume: 19 Issue: 82, 45 - 62, 31.07.2019

Samsul Hadı Dedek Andrıan Badrun Kartowagıran

Abstract

Purpose:
The
impact of decentralization on education systems requires the local government
to develop local content curriculum to preserve regional characteristics and
local uniqueness through education. Practice in the field revealed problems in
terms of implementation so that the development of an evaluation model in
accordance with the characteristics of the region is necessary. The purpose of
this study was to produce an evaluation model for evaluating vocational skills
programs on the local content curriculum.  

Method: This was a developmental study
consisting of three phases: 1) The initial investigative phase was conducted by
interviewing vice-principals and vocational skills programs teachers;2) The
design phase was carried out by making an instrument, evaluation guide,
evaluation procedure and the effectiveness of the model assessment sheet; 3)
The trial phases were carried out by performing readability test, small-scale
trial, and large-scale trial.

Results: The results of the readability test indicated that
evaluation instrument, evaluation guide, and evaluation procedure were feasible
to use, and according to experts the model was very effective to evaluate
vocational skills programs on the local content curriculum. The result of the
small-scale trial showed that the 24 items developed were valid and reliable.
Large-scale trial results indicated that the instrument had acceptable validity
and reliability of the construct.

Implications for
Research and Practice: Evaluation models
that have been developed, validated by experts, validated by practitioners and
trials on the small and large-scale can contribute to improving vocational
skills programs on the local content curriculum developed by local governments
throughout Indonesia and even other countries.

Keywords

evaluation model, vocational skills programs

References

• Andrian, D., Kartowagiran, B., &Hadi, S. (2018). The instrument development to evaluate local curriculum in Indonesia. International Journal of Instruction, 11(4), 921-934. https://doi.org/10.12973/iji.2018.11458a
• Adin-Surkis, A. (2016). Teachers evaluate the new curriculum in English: Views regarding evaluation and evaluation tools. Research in Education, (93). https://doi.org/http://dx.doi.org/10.7227/RIE.0009
• Akker, J.V.D., & Verloop, N. (1994). Evaluation approaches and results in curriculum research and development in The Netherlands. Studies in Educational Evaluation, 20(4), 421–436. doi:10.1016/0191-491x(94)00035-f
• Akshay, N., Deepu, S., Rahul, E. S., Ranjith, R., Jose, J., Unnikrishnan, R., & Bhavani, R. R. (2013). Design and evaluation of a haptic simulator for vocational skill Training and Assessment. IECON Proceedings (Industrial Electronics Conference), 6108–6113. https://doi.org/10.1109/IECON.2013.6700139
• Bayraktar, E., Tatoglu, E., & Zaim, S. (2008). An instrument for measuring the critical factors of TQM in Turkish higher education. Total Quality Management & Business Excellence, 19(6), 551–574. doi:10.1080/14783360802023921
• Bharvad, A. J. (2010). Curriculum Evaluation, I(12), 2009–2011.
• Borg, W R & Gall, M. D. (1983). Educational Research Forth Edition. New York: Longman.
• Brown, M., Sack, F., & Piper Rodd, C. (2013). Student voice in “skills for sustainability”: A missing component from the demand side of Australian vocational education and training. International Journal of Training Research, 11(3), 213–224. doi:10.5172/ijtr.2013.11.3.213
• Burton, L. J., & Mazerolle, S. M. (2011). Survey Instrument Validity Part I: Principles of Survey Instrument Development and Validation in Athletic Training Education Research. Journal of Athletic Training Education, 6(1), 27–35.
• Council, N. R. (2004). On evaluating curricular effectiveness judging the quality. Washington: National Academies Press.
• Depdiknas. (2006). Regulation of the Minister of National Education of the Republic of Indonesia Number 22 of 2006. Appendix About Standard Content, 1-48
• Eğmir, E., Erdem, C., &Koçyiğit, M. (2017). Trends in educational research: A content analysis of the studies published in international journal of instruction. International Journal of Instruction, 10(3), 277–294. https://doi.org/10.12973/iji.2017.10318a
• Figueiredo, C., Leite, C., & Fernandes, P. (2016). The curriculum in school external evaluation frameworks in Portugal and England. Research in Comparative and International Education, 11(3), 282–297. https://doi.org/10.1177/1745499916661933
• Fink, C.R., & Crunkilton, J. (1999). Curriculum development in vocational and technical education. Planning, content, and implementation. Boston: Allyn and Bacon Inc.
• Haghparast, N., Sedghizadeh, P. P., Shuler, C. F., Ferati, D., &Christersson, C. (2007). Evaluation of student and faculty perceptions of the PBL curriculum at two dental schools from a student perspective: a cross-sectional survey. European Journal of Dental Education, 11(1), 14–22. https://doi.org/10.1111/j.1600-0579.2007.00423.x
• Hair Jr, J. F., William, C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis. Upper Saddle River: Pearson
• Hakan, K., & Seval, F. (2011). CIPP evaluation model scale: development, reliability and validity. Procedia - Social and Behavioral Sciences, 15, 592–599. doi:10.1016/j.sbspro.2011.03.146
• Hassall, T., Joyce, J., Arquero Montaño, J. L., & Donoso Anes, J. A. (2005). Priorities for the development of vocational skills in management accountants: A European perspective. Accounting Forum, 29(4), 379–394. doi:10.1016/j.accfor.2005.03.002
• Howell, K.W.,&Nolet, V. (2000). Curriculum based evaluation: teaching and decision making. Belmont: Wadswortth Thomson Learning.
• Hussain, A., Dogar, A. H., Azeem, M., & Shakoor, A. (2011). Evaluation of Curriculum Development Process. International Journal of Humanities and Social Science, 1(14), 263–271.
• Leathwood, C., & Phillips, D. (2000). Developing curriculum evaluation research in higher education : Procesa, politics and practicalities. Higher Education, 40(3), 313–330. https://doi.org/10.1023/a:1004183527173
• Loiacono, E., Watson, R., & Goodhue, D. (2007). WebQual: An Instrument for Consumer Evaluation of Web Sites. International Journal of Electronic Commerce, 11(3), 51–87. https://doi.org/10.2753/JEC1086-4415110302
• Merritt, B. K., Blake, A. I., McIntyre, A. H., & Packer, T. L. (2012). Curriculum evaluation: Linking curriculum objectives to essential competencies. Canadian Journal of Occupational Therapy, 79(3), 175–180. https://doi.org/10.2182/cjot.2012.79.3.7
• Miles, M. B., & Huberman, M. a. (1994). Qualitative data analysis: An expanded sourcebook. Evaluation and Program Planning. https://doi.org/10.1016/0149-7189(96)88232-2
• Montano, J. L. A., Donoso, J. A., Hassall, T., & Joyce, J. (2001). Vocational skills in the accounting professional profile: the Chartered Institute of Management Accountants (CIMA) employers’ opinion. Accounting Education, 10(3), 299–313. https://doi.org/10.1080/09639280210122339
• Powell, J. J. W., Bernhard, N., & Graf, L. (2012). The emergent European model in skill formation: Comparing higher education and vocational training in the Bologna and Copenhagen processes. Sociology of Education, 85(3), 240–258. https://doi.org/10.1177/0038040711427313
• Prastiwi, Y. (2013). Transmitting Local Cultural Knowledge through English as Foreign Language (EFL) Learning as a Means of Fostering “Unity in Diversity.” Academic Journal of Interdisciplinary Studies, 2(3), 507–514. https://doi.org/10.5901/ajis.2013.v2n3p507
• Saputra, G. A. S. (2013). Enhancing Local Wisdom Through Local Content Of Elementary School in Java, Indonesia. Proceeding Of the Glbal Summit on Education, 2013(March), 11–12.
• Sorenson, R., Goldsmith, Ll., Mendez, Z., & Maxwell, K. (1979). Curriculum development in vocational and technical education. London: SAGE Company.
• Sultan, Rofiuddin, A., Nurhadi, & Priyatni, E. T. (2017). The development of a critical reading learning model to promote university students’ critical awareness. New Educational Review, 48(2004), 76–86. https://doi.org/10.15804/tner.2017.48.2.06
• Suryadi, B., Ekayanti, F., & Euis, A. (2017). An integrated curriculum at an islamic university: perceptions of students and lecturers, Eurasian Journal of Educational Research, 67(January), 161–182. https://doi.org/10.14689/ejer.2018.74.2
• Syomwene, A., Kitainge, K., &Mwaka, M. (2013). Psychological influences in the curriculum decision making process. Journal of Education and Practice, 4(8), 173–181. https://doi.org/ISSN 2222-1735.
• The National Research Council (2004). On evaluating curricular effectiveness judging the quality of k-12 mathematics evaluations. Washington: The National Academies Press.
• Ungar, W. J., & Santos, M. T. (2003). The pediatric quality appraisal questionnaire: An instrument for evaluation of the pediatric health economics literature. Value in Health, 6(5), 584–594. https://doi.org/10.1046/j.1524-4733.2003.65253.x
• Uys, L. R., & Gwele, N. S. (2005). Curriculum development in nursing: process and innovation, South Africa: Psychology Press.
• Van den Akker, J., & Verloop, N. (1994). Evaluation approaches and results in curriculum research and development in The Netherlands. Studies in Educational Evaluation, 20(4), 421–436. doi:10.1016/0191-491x(94)00035-f
• Yeung, S. S. (2010). Using School Evaluation Policy to Effect Curriculum Change? A Reflection on the SSE and ESR Exercise in Hong Kong, Educational Research Journal 25(2), 187-209