Evaluation Model for Evaluating Vocational Skills Programs on Local Content Curriculum in Indonesia: Impact of Educational System in Indonesia

Abstract

Purpose: The impact of decentralization on education systems requires the local government to develop local content curriculum to preserve regional characteristics and local uniqueness through education. Practice in the field revealed problems in terms of implementation so that the development of an evaluation model in accordance with the characteristics of the region is necessary. The purpose of this study was to produce an evaluation model for evaluating vocational skills programs on the local content curriculum.  

Method: This was a developmental study consisting of three phases: 1) The initial investigative phase was conducted by interviewing vice-principals and vocational skills programs teachers;2) The design phase was carried out by making an instrument, evaluation guide, evaluation procedure and the effectiveness of the model assessment sheet; 3) The trial phases were carried out by performing readability test, small-scale trial, and large-scale trial.

Results: The results of the readability test indicated that evaluation instrument, evaluation guide, and evaluation procedure were feasible to use, and according to experts the model was very effective to evaluate vocational skills programs on the local content curriculum. The result of the small-scale trial showed that the 24 items developed were valid and reliable. Large-scale trial results indicated that the instrument had acceptable validity and reliability of the construct.

Implications for Research and Practice: Evaluation models that have been developed, validated by experts, validated by practitioners and trials on the small and large-scale can contribute to improving vocational skills programs on the local content curriculum developed by local governments throughout Indonesia and even other countries.

Keywords

• evaluation model,vocational skills programs

References

1. Andrian, D., Kartowagiran, B., &Hadi, S. (2018). The instrument development to evaluate local curriculum in Indonesia. International Journal of Instruction, 11(4), 921-934. https://doi.org/10.12973/iji.2018.11458a
2. Adin-Surkis, A. (2016). Teachers evaluate the new curriculum in English: Views regarding evaluation and evaluation tools. Research in Education, (93). https://doi.org/http://dx.doi.org/10.7227/RIE.0009
3. Akker, J.V.D., & Verloop, N. (1994). Evaluation approaches and results in curriculum research and development in The Netherlands. Studies in Educational Evaluation, 20(4), 421–436. doi:10.1016/0191-491x(94)00035-f
4. Akshay, N., Deepu, S., Rahul, E. S., Ranjith, R., Jose, J., Unnikrishnan, R., & Bhavani, R. R. (2013). Design and evaluation of a haptic simulator for vocational skill Training and Assessment. IECON Proceedings (Industrial Electronics Conference), 6108–6113. https://doi.org/10.1109/IECON.2013.6700139
5. Bayraktar, E., Tatoglu, E., & Zaim, S. (2008). An instrument for measuring the critical factors of TQM in Turkish higher education. Total Quality Management & Business Excellence, 19(6), 551–574. doi:10.1080/14783360802023921
6. Bharvad, A. J. (2010). Curriculum Evaluation, I(12), 2009–2011.
7. Borg, W R & Gall, M. D. (1983). Educational Research Forth Edition. New York: Longman.
8. Brown, M., Sack, F., & Piper Rodd, C. (2013). Student voice in “skills for sustainability”: A missing component from the demand side of Australian vocational education and training. International Journal of Training Research, 11(3), 213–224. doi:10.5172/ijtr.2013.11.3.213

9. Burton, L. J., & Mazerolle, S. M. (2011). Survey Instrument Validity Part I: Principles of Survey Instrument Development and Validation in Athletic Training Education Research. Journal of Athletic Training Education, 6(1), 27–35.
10. Council, N. R. (2004). On evaluating curricular effectiveness judging the quality. Washington: National Academies Press.
11. Depdiknas. (2006). Regulation of the Minister of National Education of the Republic of Indonesia Number 22 of 2006. Appendix About Standard Content, 1-48
12. Eğmir, E., Erdem, C., &Koçyiğit, M. (2017). Trends in educational research: A content analysis of the studies published in international journal of instruction. International Journal of Instruction, 10(3), 277–294. https://doi.org/10.12973/iji.2017.10318a
13. Figueiredo, C., Leite, C., & Fernandes, P. (2016). The curriculum in school external evaluation frameworks in Portugal and England. Research in Comparative and International Education, 11(3), 282–297. https://doi.org/10.1177/1745499916661933
14. Fink, C.R., & Crunkilton, J. (1999). Curriculum development in vocational and technical education. Planning, content, and implementation. Boston: Allyn and Bacon Inc.
15. Haghparast, N., Sedghizadeh, P. P., Shuler, C. F., Ferati, D., &Christersson, C. (2007). Evaluation of student and faculty perceptions of the PBL curriculum at two dental schools from a student perspective: a cross-sectional survey. European Journal of Dental Education, 11(1), 14–22. https://doi.org/10.1111/j.1600-0579.2007.00423.x
16. Hair Jr, J. F., William, C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis. Upper Saddle River: Pearson
17. Hakan, K., & Seval, F. (2011). CIPP evaluation model scale: development, reliability and validity. Procedia - Social and Behavioral Sciences, 15, 592–599. doi:10.1016/j.sbspro.2011.03.146
18. Hassall, T., Joyce, J., Arquero Montaño, J. L., & Donoso Anes, J. A. (2005). Priorities for the development of vocational skills in management accountants: A European perspective. Accounting Forum, 29(4), 379–394. doi:10.1016/j.accfor.2005.03.002
19. Howell, K.W.,&Nolet, V. (2000). Curriculum based evaluation: teaching and decision making. Belmont: Wadswortth Thomson Learning.
20. Hussain, A., Dogar, A. H., Azeem, M., & Shakoor, A. (2011). Evaluation of Curriculum Development Process. International Journal of Humanities and Social Science, 1(14), 263–271.
21. Leathwood, C., & Phillips, D. (2000). Developing curriculum evaluation research in higher education : Procesa, politics and practicalities. Higher Education, 40(3), 313–330. https://doi.org/10.1023/a:1004183527173
22. Loiacono, E., Watson, R., & Goodhue, D. (2007). WebQual: An Instrument for Consumer Evaluation of Web Sites. International Journal of Electronic Commerce, 11(3), 51–87. https://doi.org/10.2753/JEC1086-4415110302
23. Merritt, B. K., Blake, A. I., McIntyre, A. H., & Packer, T. L. (2012). Curriculum evaluation: Linking curriculum objectives to essential competencies. Canadian Journal of Occupational Therapy, 79(3), 175–180. https://doi.org/10.2182/cjot.2012.79.3.7
24. Miles, M. B., & Huberman, M. a. (1994). Qualitative data analysis: An expanded sourcebook. Evaluation and Program Planning. https://doi.org/10.1016/0149-7189(96)88232-2
25. Montano, J. L. A., Donoso, J. A., Hassall, T., & Joyce, J. (2001). Vocational skills in the accounting professional profile: the Chartered Institute of Management Accountants (CIMA) employers’ opinion. Accounting Education, 10(3), 299–313. https://doi.org/10.1080/09639280210122339
26. Powell, J. J. W., Bernhard, N., & Graf, L. (2012). The emergent European model in skill formation: Comparing higher education and vocational training in the Bologna and Copenhagen processes. Sociology of Education, 85(3), 240–258. https://doi.org/10.1177/0038040711427313
27. Prastiwi, Y. (2013). Transmitting Local Cultural Knowledge through English as Foreign Language (EFL) Learning as a Means of Fostering “Unity in Diversity.” Academic Journal of Interdisciplinary Studies, 2(3), 507–514. https://doi.org/10.5901/ajis.2013.v2n3p507
28. Saputra, G. A. S. (2013). Enhancing Local Wisdom Through Local Content Of Elementary School in Java, Indonesia. Proceeding Of the Glbal Summit on Education, 2013(March), 11–12.
29. Sorenson, R., Goldsmith, Ll., Mendez, Z., & Maxwell, K. (1979). Curriculum development in vocational and technical education. London: SAGE Company.
30. Sultan, Rofiuddin, A., Nurhadi, & Priyatni, E. T. (2017). The development of a critical reading learning model to promote university students’ critical awareness. New Educational Review, 48(2004), 76–86. https://doi.org/10.15804/tner.2017.48.2.06
31. Suryadi, B., Ekayanti, F., & Euis, A. (2017). An integrated curriculum at an islamic university: perceptions of students and lecturers, Eurasian Journal of Educational Research, 67(January), 161–182. https://doi.org/10.14689/ejer.2018.74.2
32. Syomwene, A., Kitainge, K., &Mwaka, M. (2013). Psychological influences in the curriculum decision making process. Journal of Education and Practice, 4(8), 173–181. https://doi.org/ISSN 2222-1735.
33. The National Research Council (2004). On evaluating curricular effectiveness judging the quality of k-12 mathematics evaluations. Washington: The National Academies Press.
34. Ungar, W. J., & Santos, M. T. (2003). The pediatric quality appraisal questionnaire: An instrument for evaluation of the pediatric health economics literature. Value in Health, 6(5), 584–594. https://doi.org/10.1046/j.1524-4733.2003.65253.x
35. Uys, L. R., & Gwele, N. S. (2005). Curriculum development in nursing: process and innovation, South Africa: Psychology Press.
36. Van den Akker, J., & Verloop, N. (1994). Evaluation approaches and results in curriculum research and development in The Netherlands. Studies in Educational Evaluation, 20(4), 421–436. doi:10.1016/0191-491x(94)00035-f
37. Yeung, S. S. (2010). Using School Evaluation Policy to Effect Curriculum Change? A Reflection on the SSE and ESR Exercise in Hong Kong, Educational Research Journal 25(2), 187-209