Development of Analytical Rubric for Evaluating the Effect of Mobile Design Applications on Artistic Creativity: Validity-Reliability Study
Abstract
Purpose: Creativity and technology are essential components of education and the future around the world. Developing students' creative thinking skills and their relationship with technology is among the main objectives of both 21st century skills and education. This study, which is based on the relationship between digital technologies and artistic creativity, aims to develop an analytical rubric to evaluate 11th grade students' artistic creativity that emerges with their use of mobile design applications.
Design & Methodology: This research is a descriptive research aiming to develop an analytical rubric with high validity, reliability and usefulness to evaluate the effect of mobile design applications on artistic creativity.
Findings: There are five criteria in the analytical rubric developed to evaluate the effect of mobile design applications on artistic creativity. Expert opinion was sought in determining the content validity of the developed analytical rubric, and principal component analysis was used in determining the construct validity. In classical test theory, Cronbach's alpha coefficient was calculated for internal consistency, and Kendall's coefficient of concordance (W) was calculated for inter-rater reliability, and in generalizability (G) theory, G and Phi coefficients were calculated. Fully crossed design was preferred in G theory analyzes. The findings obtained show that the developed analytical rubric gives reliable results in evaluating the artistic creativity of the students.
Implications & Suggestions: An analytical rubric was developed to evaluate the 11th grade students' artistic creativity that emerge through the designs made with mobile design applications and the validity and reliability proofs of the rubric were revealed. As a result of the analysis, it was concluded that the developed Creativity Level Analytical Rubric (CLAR) is a reliable and valid measurement tool. It is recommended to increase the number of studies to develop tools that can evaluate artistic creativity and the relationship between creativity and technology at all levels of education.
Keywords
Analytical rubric , Creativity , Art education; Mobile design applications; Generalizability theory
Kaynakça
- Arieti, S. (2016). Büyülü bireşim yaratıcılık. [Magical synthesis of creativity]. Kurgu Kültür Merkezi Yayınları
- Arslan Mancar, S. (2019). Performansa dayalı durum belirlemede puanlayıcılar arası güvenirlik tekniklerinin karşılaştırılması.[The comparison of inter rater reliability estimating techniques in performance based assessment] [Master's thesis, Instıtute of Educatıon Scıences]. Council of Higher Education, Thesis Center. https://tez.yok.gov.tr
- Bacanlı H., Dombaycı M. A., Demir M., Tarhan S. (2011). Quadruple thinking: Creative thinking. Procedia-Social and Behavioral Sciences, 12, 536-544.
- Bıkmaz Bilgen, Ö. & Doğan, N. (2017). Puanlayıcılar arası güvenirlik belirleme tekniklerinin karşılaştırılması [The Comparison of interrater reliability estimating techniques]. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi.8(1), 63-78.
- Bolden, B., DeLuca, C., Kukkonen T., Roy S., & Wearing J. (2020). Assessment of creativity in k‐12 education: a scoping review. Review of Education. 8(2), 343-376.
- Black, J. & Browning, K (2011). Creativity in Digital Art Education Teaching Practices. Art Education, 64(5), 19-34.
- Brown University (2020, November 4). Rubric scales, https://www.brown.edu/sheridan/teaching-learning-resources/teaching-resources/course-design/classroom-assessment/grading-criteria/rubrics-scales
- Campell, A., (2005). Application of ICT and rubrics to the assessment process where professional judgement is involved: the features of an e‐marking tool. Assesment and Evoluation in Higher Education. 529-537. https://doi.org/10.1080/02602930500187055
- Conrad, S. D. (1990). Toward a phenomenological analysis of artistic creativity. Journal of Phenomenological Psychology, 21(2), 103-120.
- Fox, J. E. & Schirrmacher, R. (2014). Çocuklarda sanat ve yaratıcılığın gelişimi [The development of art and creativity in children].(N. Aral, G. Duman, Çev.). Nobel.