Development of a Media Literacy Skills Scale

Abstract

This study aims to develop a reliable and valid scale to identify the levels of media users’ media literacy skills. The scale development process was carried out in nine steps as recommended in the literature. Before the scale was administered, the items were reviewed by field experts and language experts and a pilot study was carried out. Responses from 322 pre-service teachers, selected via purposeful sampling, were included in the analysis. Item discrimination was tested via item-total correlation and it indicated that none of the items were below .30. In the confirmatory factor analysis, it was found out that the scale and the theoretical model showed a fit between good and acceptable. Convergent validity, divergent validity and 27% upper-lower group means were also examined. As for the internal consistency, Cronbach’s alpha value of the scale was calculated as .919 and alpha values of the factors were calculated as .768, .833, .720 and .838 respectively. The results revealed that Media Literacy Skills Scale, which consists of 45 items gathered under the four main factors of ‘access, analyze, evaluate and communicate’, is a reliable and valid measurement instrument. This up-to-date scale covers all main skills of media literacy and it consists of a sufficient number of questions to obtain rich data and ensure measurement precision. In addition, it covers new media as well as mass media and this

Keywords

• Media literacy,Scale development,Media literacy skills,New media,Confirmatory factor analysis

References

1. Alvermann, D. E. & Hagood, M. C. (2000). Critical media literacy: Research, theory, and practice in “new times”. The Journal of Educational Research, 93(3), 193-205.
2. Andersen, N. (2002). New media and new media literacy: The horizon has become the landscape-new media are here. Report produced by cable in the classroom (pp.30-35). Retrieved on 20 January 2016 from http://www.medialit.org/reading-room/new-mediaand-new-media-literacy.
3. Anderson, S., & Balsamo, A. (2008). A pedagogy for original Synners. In T. McPherson (Ed.), Digital youth, innovation, and the unexpected (pp. 241-259). Cambridge: The MIT Press.
4. Ashley, S., Maksl, A. & Craft, S. (2013). Developing a news media literacy scale. Journalism & Mass Communication Educator, 3(1), 1-15.
5. Asici, M. (2009). Kisisel ve sosyal bir deger olarak okuryazarlik [Literacy as a personal and social value]. Degerler Egitimi Dergisi, 7(17), 9-26.
6. Aufderheide, P. (1993). Media Literacy: A report of the national leadership conference on media literacy. Washington, DC: Aspen Institute.
7. Aybek, B. & Demir, R. (2014). The analysis of the levels of media and television literacy of high school students in terms of different variables. Cukurova University Faculty of Education Journal, 43(1), 46-62.
8. Ayres, K. M., Langone, J. & Douglas, K. (2009). Technology, UDL & literacy activities for people with developmental delays. In L. T. W. Hin & R. Subramaniam (Eds.), Handbook of research on new media literacy at the K-12 level: issues and challenges. New York: IGIGlobal.

9. Bachmair, B. & Bazalgette, C. (2007). The European charter for media literacy: meaning and potential. Research in Comparative and International Education, 2(1), 80-87.
10. Baran, S. (2014). Introduction to mass communication: Media literacy and culture. New York: McGraw Hill.
11. Bawden, D. (2001). Information and digital literacies: A review of concepts. Journal of Documentation, 57(2), 218-259.
12. Bawden, D. & Robinson, L. (2009). The dark side of information: overload, anxiety and other paradoxes and pathologies. Journal of Information Science, 35(2), 180-191.
13. Bilici, İ. E. (2014). Medya okuryazarligi ve egitimi [Media literacy and its education]. Ankara: Nobel.
14. Buyukozturk, S. (2010). Sosyal bilimler için veri analizi el kitabı [Data analysis handbook for social sciences]. Ankara: Pegem Akademi.
15. Caperton, I. H. (2010). Toward a Theory of Game-Media Literacy: Playing and Building as Reading and Writing. International Journal of Gaming and Computer-Mediated Simulations, 2(1), 1-16.
16. Chang, C., Liu, E. Z., Lee, C., Chen, N., Hu, D. & Lin, C. (2011). Developing and validating a media literacy self-evaluation scale (MLSS) for elementary school students. The Turkish Online Journal of Educational Technology, 10(2), 63-71.
17. Chen, D. T., Wu, J., & Wang, Y.-M. (2011). Unpacking new media literacy. Journal on Systemics, Cybernetics and Informatics, 9(2), 84-88.
18. Creswell, J. W. (2002). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Upper Saddle River, NJ: Pearson Education.
19. Cepni, O., Palaz, T. & Ablak, S. (2015). Examining prospective social sciences teachers’ level of media and television literacy according to different variables. International periodical for the languages, literature and history of Turkish or Turkic, 10(11), 431-446.
20. DeVellis, R. F. (2003). Scale development: Theory and applications. London: Sage.
21. Engin, G. & Genc, S. Z. (2015). Examination on media literacy behaviours of teacher candidates: Ege University sample. The International Journal of Research in Teacher Education, 6(2), 1-10.
22. Gentry, J. & McAdams, L. (2013). Digital story expressions: blending best practices in literacy and technology with middle school students. In American Association of Computing in Education: Paper IP 37529 (4253-4257). Chesapeake, VA: Proceedings of Society for Information Technology & Teacher Education International Conference 2013. Retrieved on 7 January 2016 from www.editlib.org/p/48794
23. Field, A. P. (2009). Discovering statistics using SPSS. London: Sage.
24. Freire, P. & Macedo, D. (1998). Literacy: Reading the word and the world. (S. Ayhan, Trans.). Ankara: Imge Kitabevi. (Original work published in 1987).
25. Hobbs, R. (2001). The great media literacy debates in 2001. Community Media Review, 21, 17- 23.
26. Hobbs, R. (2010). Digital and media literacy: A plan of action. Washington, DC: The Aspen Institute.
27. Hobbs, R. & Moore D. C. (2013). Discovering media literacy: teaching digital media and popular culture in elementary schools. Thousand Oaks, CA: Corwin.
28. Hofstetter, F.T. (2002). Internet literacy (3rd Ed). New York: McGraw Hill.
29. Hsu, Y., Ching, Y. & Grabowski, B. (2009). Web 2.0 technologies as cognitive tools of the new media age. In L. T. W. Hin & R. Subramaniam (Eds.), Handbook of research on new media literacy at the K-12 level: issues and challenges. New York: IGI- Global.
30. Ivanovic, M. (2014). Development of media literacy – An important aspect of modern education. Procedia - Social and Behavioral Sciences, 149(5), 438-442.
31. Inal, K. (2009). Medya okuryazarligi el kitabı [Media literacy handbook]. Ankara: Utopya.
32. Jenkins, H., Purushotma, R., Clinton, K., Weigel, M., & Robison, A. J. (2006). Confronting the challenges of participatory culture: Media education for the 21th century. The MIT Press. Retrieved on 15 January 2016 from https://mitpress.mit.edu/sites/default/files/titles/ free_download/9780262513623_Confronting_the_Challenges.pdf
33. Jolls, T. (2008). Literacy for the 21st century: an overview & orientation guide to media literacy education. Center for Media Literacy. Retrieved on 2 January 2016 from http://medialit. org/medialitkit.html
34. Joreskog, K. G. & Sorbom, D. (1993). Lisrel 8: Structural equation modeling with the simplis command language. Lincolnwood: Scientific Software International.
35. Karaman, K. & Karatas, A. (2009). Ogretmen adaylarinin medya okuryazarlik duzeyleri [Media literacy levels of teacher candidates]. Ilkogretim Online, 8(3), 798-808.
36. Kellner, D. (2001). New technologies/new literacies: reconstructing education for the new millennium. International Journal of Technology and Design Education, 11, 67-81.
37. Kellner, D. & Share, J. (2005). Toward critical media literacy: core concepts, debates, organizations and policy. Discourse: studies in the cultural politics of education, 26(3), 369-386.
38. Kellner, D. & Share, J. (2007). Critical media literacy, democracy and the reconstruction of education. In D. Macedo & S. R. Steinberg (Eds.), Media Literacy: A reader (pp.3-23) New York: Peter Lang Publishing.
39. Kline, R. B. (2011). Principles and practice of structural equation modelling. New York: The Guilford Press.
40. Koltay, T. (2011). The media and the literacies: Media literacy, information literacy, digital literacy. Media, Culture & Society, 33(2), 211-221.
41. Korkmaz, O. & Yesil, R. (2011). Medya ve televizyon okuryazarlik duzeyleri olçegi gecerlik ve guvenirlik calismasi [Study of validity and reliability scale of media and television literacy levels]. Uluslararasi Insan Bilimleri Dergisi, 8(2), 110-126.
42. Kress, G. (2003). Literacy in the new media age. London: Routledge.
43. Lankshear, C. & McClaren, P. (1993). Critical literacy: radical and postmodernist perspectives. Albany, NY: SUNY Press.
44. Lewis, J. & Jhally, S. (1998). The struggle over media literacy. Journal of Communication, 48(1), 109-120.
45. Lievrouw, L. & Livingstone, S. (2006) Introduction to the updated student edition. In L. Lievrouw, & S. Livingstone (Eds.), Handbook of new media: Social shaping and social consequences (pp.1-14). London: Sage
46. Literat, I. (2014). Measuring new media literacies: Towards the development of a comprehensive assessment tool. Journal of Media Literacy Education, 6(1), 15-27.
47. Livingstone, S. (2003). The changing nature and uses of media literacy. MEDIA@LSE Electronic Working Papers. 4.
48. Livingstone, S. (2004). Media literacy and the challenge of new information and communication Technologies. The Communication Review, 7(1), 3-14.
49. Lundgren, B. (2013). Exploring critical literacy in Swedish education- introductory notes. Education Inquiry, 4(2), 215-223.
50. Onal, İ. (2010). Tarihsel degisim sürecinde yasam boyu ögrenme ve okuryazarlik: Türkiye deneyimi [Lifelong learning and literacy in process of historical change: A Turkish experience]. Bilgi Dunyasi, 11(1), 101-121.
51. Ozdamar, K. (2011). Paket programlar ile istatistiksel veri analizi [Statistical data analysis with package programs]. Eskisehir: Kaan Kitabevi.
52. Pérez Tornero, J. M., Celot P. & Varis T. (2007). Current trends and approaches to media literacy in Europe. Brussels: European Commission. Retrieved on 5 January 2016 from http://ec.europa.eu/assets/eac/culture/library/studies/literacy-trends-report_en.pdf
53. Pérez Tornero, J. M. & Varis, T. (2010). Media literacy and new humanism. Moscow: UNESCO Institute for Information Technologies in Education.
54. Potter, W. J. (2008). Media Literacy. Thousand Oaks, CA: Sage.
55. Potter, W. J. (2009). Media literacy. In W. F. Eadie (Ed.), 21st century communication, a reference (pp. 558-567). Thousand Oaks, CA: Sage.
56. Potter, W. J. (2010). The state of media literacy. Journal of Broadcasting & Electronic Media, 55(4), 675-696.
57. Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research-Online, 8, 23-74.
58. Schmidt, H. C. (2013). Media literacy education from kindergarten to college: A comparison of how media literacy is addressed across the educational system. Journal of Media Literacy Education, 5(1), 295-309.
59. Silver, A. (2009). A European approach to media literacy: moving toward an inclusive knowledge society. In D. Frau-Meigs & J. Torrent (Eds.), Mapping media education policies in the world: Visions, programmes and challenges (pp. 11-13). New York: UNAlliance of Civilizations.
60. Silverblatt, A., Smith, A., Miller, D., Smith, J. & Brown, N. (2014). Media literacy: Keys to interpreting media messages. Santa Barbara: Praeger.
61. Som, S. & Kurt, A. A. (2012). Media literacy levels of students attending the department of computer education and instructional technologies. Anadolu Journal of Educational Sciences International, 2(1), 104-119.
62. Sahin, A. (2014). Elestirel medya okuryazarligi [Critical media literacy]. Ankara: Ani.
63. Sencan, H. (2005). Sosyal ve davranissal olcumlerde guvenirlik ve gecerlilik [Reliability and validity in social and behavioral measurements]. Ankara: Seckin.
64. Tekindal, S. (2009). Duyussal ozelliklerin olculmesi icin arac olusturma [Developing instruments for measuring affective characteristics]. Ankara: Pegem Akademi.
65. Taskiran, N. O. (2007). Medya okuryazarligina giris [Introduction to media literacy]. Istanbul: Beta.
66. Tavsancil, E. (2006). Tutumların olculmesi ve SPSS ile veri analizi [Measuring attitudes and data analysis with SPSS]. Ankara: Nobel.
67. Thoman, E. & Jolls, T. (2005). Literacy for the 21st century: An overview & orientation guide to media literacy education. CML Media Lit Kit. Retrieved on 5 January 2016 from http://www.medialit.org/sites/default/files/mlk/01_MLKorientation.pdf
68. Thompson, B. (2004). Exploratory and confirmatory factor analysis: understanding concepts and applications. Washington DC: American Psychological Association.
69. Torres, M. & Mercado, M. (2006). The need for critical media literacy in teacher education core curricula. Educational Studies, 39(3), 260-282.
70. Volvic, Z. (2003). Who wants to be a media literate? Locating media research methods and applying them to the media literacy concept. Croatian Journal for Journalism and the Media, 9(2), 35-66
71. Walsh, M. (2010). Multimodal literacy: What does it mean for classroom practice? Australian Journal of Language and Literacy. 33(3), 211–239