Turkish Language Teachers’ Higher-Order Thinking Question Preparation Competencies
Yıl 2024,
Cilt: 25 Sayı: 2, 1173 - 1216, 30.08.2024
Tuba Acar Erdol
,
Emel Bayrak Özmutlu
,
Pınar Kanık Uysal
,
Çiğdem Akın Arıkan
Öz
The goal of this study is to examine native language teachers’ competencies in preparing higher-order thinking questions. Designed as a descriptive research, this study was conducted through a document analysis method. The data consisted of questions prepared by teachers employed in secondary schools in a medium-sized city in Turkey. A higher-order question preparation guideline was used as a data collection tool, and the analysis was carried out in two stages. First, the items were analyzed using Revised Bloom's Taxonomy. Second, a categorical content analysis was conducted to determine which thinking skills were measured by the questions that targeted higher-order thinking skills. Findings showed that only 12.8% of the questions measured higher-order thinking skills. It was also found that the questions largely focused on measuring meaning-based structuring, inference, comparison, and application thinking skills, while they were insufficient in measuring self-evaluation, problem solving, discussion, sequencing, and questioning skills. This research revealed that teachers had serious problems with authoring questions for higher-order thinking and that they needed immediate training in this regard.
Kaynakça
- Acar-Erdol, T. (2020). Analysis of the questions in 11th Grade Philosophy Coursebook in terms of higher-order thinking skills. Turkish Journal of Education, 9(3), 222-245. https://doi.org/10.19128/turje.695928
- Acar-Erdol, T. (2022). Teaching collaborative problem solving skills, M. K. Yöntem (Ed.). Effective university education with practical examples, (pp. 133-160). Eğitim Publishing.
- Airasian, P. W., & Russell, M. K. (2008). Classroom assessment concepts and applications. McGraw-Hill Education.
- Akyol, H., Yıldırım, K. , Ateş, S., & Çetinkaya, Ç. (2013). What kinds of questions do we ask for making meaning? Mersin University Journal of Faculty Education, 9(1), 41-56.
- Altun, K. (2021). Examination of the theme evaluation questions in 8th-grade Turkish textbook according to PISA levels and Revised Bloom Taxonomy (Publication No.675192) [Master Thesis, Necmettin Erbakan University]. Council of Higher Education Thesis Center.
- Anderson, D. K., Schoenleber, M., & Korshavn, S. (2023). Higher-Order Clicker Questions Engage Students and Prepare Them for Higher-Order Thinking Activities. Journal of Microbiology & Biology Education, 24(1), e00151-22. https://doi.org/10.1128/jmbe.00151-22
- Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of educational objectives. Longman.
- Arap, B. (2015). Examination of the questions used by secondary school turkish teachers for text processing process: a case study [Unpublished master's thesis]. Çanakkale Onsekiz Mart University.
- Assaly, I., & Jabarin, A. (2021). Arab Israeli EFL teachers’ perceptions and practices vis-à-vis teaching higher-order thinking skills: A complicated relationship. Language Teaching Research, 0(0). https://doi.org/10.1177/13621688211032426
- Ateş, S. (2013). Eleştirel okuma ve bir beceri olarak öğretimi. Turkish Journal of Education, 2(3), 40-49. https://doi.org/10.19128/turje.181063
- Ateş, S., Güray, E., Döğmeci, Y., & Gürsoy, F. F. (2016). Comparison of questions of teachers and students in terms of level. Research in Reading & Writing Instruction, 4(1), 1-13. https://dergipark.org.tr/tr/pub/oyea/issue/27301/287409
- Aydemir, Y., & Çiftçi, Ö. (2008). A research on asking question ability of literature teacher candidates (Gazi University education faculty pattern). Van Yüzüncü Yıl University Journal of Education, 5(2), 103 115. https://dergipark.org.tr/tr/pub/yyuefd/issue/13714/
- Barnett, J. E., & Francis, A. L. (2012). Using higher order thinking questions to foster critical thinking: a classroom study. Educational Psychology, 32(2), 201-211. http://dx.doi.org/10.1080/01443410.2011.638619
- Batur, Z., & Ulutaş, M. (2013). An analyze of th correspondence levels between Turkish reading proficiency objectives and the PISA scale. International Journal of Social Science, 6(2), 1549-1563. https://doi.org/10.9761/jasss_651
- Bayrak-Özmutlu, E. (2020). The distribution of the mother tongue curricula learning outcomes based on the thinking skills. Cukurova University Faculty of Education Journal, 49 (1), 185-224. https://dergipark.org.tr/en/pub/cuefd/issue/53758/623935
- Bayrak Özmutlu, E. & Kanık Uysal, P. (2021). Investigation of activities in turkish textbooks in terms of thinking skills. Pamukkale University Journal of Education, 52, 518-543. https://10.9779/pauefd.745469
- Baysen, E. (2006). The levels of teacher questions and student answers. Kastamonu Education Journal, 14(1), 21-28. https://dergipark.org.tr/en/pub/kefdergi/issue/49106/626652
- Belet Boyacı, Ş. D., & Güner Özer, M. (2019). The future of learning: Turkish language course curricula from the perspective of 21st century skills. Anadolu Journal of Educational Sciences International, 9(2), 708-738. https://doi.org/10.18039/ajesi.578170
- Benzer, A. (2019). Challenge PISA reading proficiency levels of turkish textbooks. Research in Reading & Writing Instruction, 7(2), 96-109. https://doi.org/10.35233/oyea.659740
- Blything, L. P., Hardie, A., & Cain, K. (2019). Question asking during reading comprehension instruction: a corpus study of how question type influences the linguistic complexity of primary school students’ responses. Reading Research Quarterly, 55(3), 443-472. https://doi.org/10.1002/rrq.279
- Bono, E. D. (2013). Kendine düşünmeyi öğret [Teach yourself to think] (S. Arıbaş, Trans.). Remzi Publishing (Original work published 2009).
- Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27-40. https://doi.org/10.3316/QRJ0902027
- Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.
- Bür, B. (2014). A study of teacher questions: Do they promote critical thinking? (Publication No. 381545) [Master Thesis, Gazi University]. Council of Higher Education Thesis Center.
- Büyükalan Filiz, S. (2007). Öğretmenler için soru sorma sanatı [Art of asking questions for teachers]. Nobel Publishing.
- Büyükalan Filiz, S., & Yıldırım, N. (2019). Analysis of secondary-school Turkish course curriculum objectives according to revised Bloom taxonomy. Elemantry Education Online, 18(4), 1550-1573. https://doi.org/10.17051/ilkonline.2019.632521
- Büyüköztürk, Ş., Çakmak, E., Akgün, Ö., Karadeniz, Ş., & Demirel, F. (2012). Bilimsel araştırma yöntemleri [Methods of scientific research]. Pegem Publishing.
- Chen, Y. (2019). Developing students’ critical thinking and discourse level writing skill through teachers’ questions: A sociocultural approach. Chinese Journal of Applied Linguistics, 42(2), 141-162. https://doi.org/10.1515/CJAL-2019-0009
- Collins, R. (2014). Skills for the 21st Century: teaching higher-order thinking. Curriculum & Leadership Journal, 12(14).
- Corbin, J., & Strauss, A. (2008). Qualitative research, Sage.
- Çakır, N. (2013). The effect of university education on the development of higher order thinking skills (Publication No. 363194) [Doctoral dissertation, Hacettepe University]. Council of Higher Education Thesis Center.
- Çerçi, A. (2018). Investigation of 2018 Turkish language curriculum (5, 6, 7, 8th grade) according to revised Bloom Taxonomy. Research in Reading & Writing Instruction, 6(2), 70-81. https://dergipark.org.tr/en/pub/oyea/issue/42065/487733
- Çintaş Yıldız, D. (2015). The analysis of Turkish course exam questions according to re-constructed bloom’s taxonomy. Gaziantep University Journal of Social Sciences, 14(2), 479-497. https://doi.org/10.21547/jss.256771
- Davoudi, M., & Sadeghi, N. A. (2015). A systematic review of research on questioning as a high-level cognitive strategy. English Language Teaching, 8(10), 76-90. http://dx.doi.org/10.5539/elt.v8n10p76
- DeJarnette, A. F., Wilke, E., & Hord, C. (2020). Categorizing mathematics teachers’ questioning: The demands and contributions of teachers’ questions. International Journal of Educational Research, 104, 101690. https://doi.org/10.1016/j.ijer.2020.101690
- Demirel, G., & Yağmur, K. (2017). An evaluation of Turkish children’s higher order thinking skills based on the international PIRLS applications Standards. Journal of Language Education and Research, 3(2), 95-106. http://dergipark.gov.tr/jlere
- Deniz, K., & Keray Dinçel, B. (2019). Turkish language teachers’ opinions about the assessment and evaluation of comprehension skills. Journal of Mother Tongue Education, 7(1), 28-64. https://doi.org/10.16916/aded.448811
- Dickey, A. B. (2018). A Quasi-experimental study of the use of higher-order questions to improve reading comprehension in beginning readers (Publication No.13425658) [Doctoral dissertation, Northcentral University]. ProQuest Dissertations and Theses Global.
- Durgun, E., & Önder, İ. (2019). The relationship of science achievement with reading comprehension, graphic reading, problem-solving skills in middle school seventh-grade students. Journal of Individual Differences in Education, 1(1), 1-13.
- Elder, L., & Paul, R. (1998). The role of Socratic questioning in thinking, teaching, and learning. The Clearing House, 71(5), 297-301. https://doi.org/10.1080/00098659809602729
- Erdoğan, T. (2017). The view of primary school fourth grade students and teachers’ questions about Turkish language lessons in the terms of the revised Bloom taxonomy. Education and Science, 42(192). https://doi.org/10.15390/eb.2017.7407
- Erman Aslanoğlu, A. (2022). Üst düzey zihinsel beceriler ve ölçülmesi [Higher order cognitive skills and measurement]. İ. Karakaya (Ed.). Açık uçlu soruların hazırlanması, uygulanması ve değerlendirilmesi [Preparation, implementation and evaluation of open-ended questions] (pp.1-26). Pegem Publishing.
- Forster, M. (2004). Higher order thinking skills. Research Developments. 11(1), 10-15.
- Fusco, E. (2015). Effective questioning strategies in the classroom. Teachers College.
- Geisinger, K. F. (2016). 21st century skills: what are they and how do we assess them?, Applied Measurement in Education, 29(4), 245-249. https://doi.org/10.1080/08957347.2016.1209207
- Güfta, H., & Zorbaz, K. Z. (2008). A review regarding levels of written examination questions for Turkish courses of the secondary school. Journal of the Cukurova University Institute of Social Sciences, 17(2), 205-218.
- Haladyna, T. M. (1997). Writing test items to evaluate higher order thinking. Allyn and Bacon.
- Hwang, G., Lai, C., Liang, J., Chu, H., & Tsai, C. (2017). A long-term experiment to investigate the relationships between high school students’ perceptions of mobile learning and peer interaction and higher-order thinking tendencies. Educational Technology Research and Development, 66(1), 75–93. https://doi.org/10.1007/s11423-017-9540-3
- Işır, E., & Uyar, Y. (2022). Investigating reading comprehension questions and student-generated questions in language lessons in terms of level. Education Quarterly Reviews, 5(4), 440-455. https://doi.org/10.31014/aior.1993.05.04.676
- İnceçam, B., Demir, E., & Demir, E. (2018). Competencies of middle school teachers to prepare open-ended items used in open-ended test for in-classroom assessment. Elementary Education Online, 17(4) 1912-1927. https://doi.org/10.17051/ilkonline.2019.506900
- İstanbullu, E. (2021). The effect of questioning teaching for reading literacy on PISA-style questioning of pre-service Turkish language teachers (Publication No.674911) [Master’s thesis, Uludağ University]. Council of Higher Education Thesis Center.
- Jansen, T., & Möller, J. (2022). Teacher judgments in school exams: Influences of students' lower-order-thinking skills on the assessment of students’ higher-order-thinking skills. Teaching and Teacher Education, 111, 103616. https://doi.org/10.1016/j.tate.2021.103616
- Kanık Uysal, P. (2022). Examination of Questions in Turkish Lesson Exam Papers in Terms of Higher-Order Thinking Skills. Journal of Mother Tongue Education, 10(1), 136-156. https://doi.org/10.16916/aded.1016659
- Kanık-Uysal, P., Akın-Arıkan, Ç., Acar-Erdol, T., Bayrak-Özmutlu, E., & Akyol, H. (2022). Examining Turkish course exam questions in terms of originality, page layout, item type, item writing criteria and cognitive level. Education and Science, 47(210), 259-280. https://doi.org/10.15390/EB.2022.10896
- Karatay, H., & Dilekçi, A. (2019). Competencies of Turkish teachers in measuring and evaluating language skills. Milli Eğitim Dergisi, 48(1), 685-716. https://dergipark.org.tr/tr/pub/milliegitim/issue/51765/674598
- Kavruk, H., & Çeçen, M. A. (2013). Evaluation of Turkish language class exam questions in point of cognitive field levels. Journal of Mother Tongue Education, 1(4), 1-9. https://doi.org/10.16916/aded.15990
- Kelley Mudie, S., & Phillips, J. (2016). To build a better question. Knowledge Quest, 44(5), 14-19.
- Krause, U., Béneker, T., van Tartwijk, J., & Maier, V. (2021) ‘Curriculum contexts, recontextualisation and attention for higher-order thinking’. London Review of Education, 19(1), 24, 1–17. https://doi.org/10.14324/LRE.19.1.24
- Ömeroğlu, A. F. (2024). Examination of the Exam Questions Used by Turkish Language Teachers in Terms of Learning Areas, Measurement and Evaluation Methods, and Cognitive Domain Levels. The Journal of International Language, Literature, Culture, History, Art and Education Research, 14, 975-992. https://10.51531/korkutataturkiyat.1398820
- Kutlu, Ö., & Altıntaş, Ö. (2021). A brief history of psychological measurements and an approach of classroom assessment in the 21st century. Trakya Journal of Education, 11(3), 1599-1620. https://doi.org/10.24315/tred.896121
- Lee, Y., & Kinzie, M. B. (2012). Teacher question and student response with regard to cognition and language use. Instructional Science, 40, 857-874. https://doi.org/10.1007/s11251-011-9193-2
- Lewis, A., & Smith, D. (1993). Defining higher order thinking, Theory Into Practice, 32(3), 131-137. https://doi.org/10.1080/00405849309543588
- Liu, Q., Wald, N., Daskon, C., & Harland, T. (2023). Multiple-choice questions (MCQs) for higher-order cognition: Perspectives of university teachers. Innovations in Education and Teaching International, 1-13. https://doi.org/10.1080/14703297.2023.2222715
- Loyens, S. M., Van Meerten, J. E., Schaap, L., & Wijnia, L. (2023). Situating higher-order, critical, and critical-analytic thinking in problem-and project-based learning environments: A systematic review. Educational Psychology Review, 35(2), 39. https://doi.org/10.1007/s10648-023-09757-x
- Lu, K., Yang, H. H., Shi, Y., & Wang, X. (2021). Examining the key influencing factors on college students’ higher-order thinking skills in the smart classroom environment. International Journal of Educational Technology in Higher Education, 18(1), 1-13. https://doi.org/10.1186/s41239-020-00238-7
- Maden, S., & Durukan, E. (2009). Assessing types, taxonomy and learning subjects of Turkish lesson esssay questions. Atatürk University Journal of Kazım Karabekir Education Faculty, 19, 95-115.
- Magnusson, C. G. (2022). Reading literacy practices in Norwegian lower-secondary classrooms: Examining the patterns of teacher questions. Scandinavian Journal of Educational Research, 66(2), 321-335. https://doi.org/10.1080/00313831.2020.1869078
- McMillan, J. H. (2015). Sınıf içi değerlendirme, etkili ölçütlere dayalı etkili bir öğretim için ilke ve uygulamalar [Classroom assessment, principles and practices for effective instruction]. (A. Arı, Trans Ed.). Eğitim Publishing.
- Milawati, M., & Suryati, N. (2019). EFL teacher’s oral questioning: Are her questions and strategies effective?. Dinamika Ilmu, 19(1), 37-55. https://doi.org/10.21093/di.v19i1.1545
- MoNE. (2017). Öğretmenlik Mesleği Genel Yeterlikleri [General Competencies for Teaching Profession]. https://oygm.meb.gov.tr/meb_iys_dosyalar/2017_12/11115355_YYRETMENLYK_MESLEYY_GENEL_YETERLYKLERY.pdf
- MoNE. (2018). 2023 Eğitim Vizyonu. https://www.gmka.gov.tr/dokumanlar/yayinlar/2023_E%C4%9Fitim%20Vizyonu.pdf
- MoNE. (2019). Türkçe Deri Öğretim Programı (İlkokul ve Ortaokul 1, 2, 3, 4, 5, 6, 7 ve 8. Sınıflar) [Turkish Language Teaching Program (Primary and Secondary School Grades 1, 2, 3, 4, 5, 6, 7 and 8)]. http://mufredat.meb.gov.tr/ProgramDetay.aspx?PID=663
- Moodley, V. (2013). In-service teacher education: Asking questions for higher order thinking in visual literacy. South African Journal of Education, 33(2), 1-18.
- Newmann, F. M. (1988). Higher order thinking in the high school curriculum. NASSP Bulletin, 72(508), 58–64. https://doi.org/10.1177/019263658807250812
- Newmann, F. M. (1990). Higher order thinking in teaching social studies: A rationale for the assessment of classroom thoughtfulness. Journal of Curriculum Studies, 22(1), 41-56.
- OECD (2018). The future of education and skills Education 2030. https://www.oecd.org/education/2030/E2030%20Position%20Paper%20(05.04.2018).pdf
- OECD (2019a). PISA 2018 results volume I: What students know and can do. OECD Publishing.
- OECD (2019b). Country Note: Turkey, Programme For International Student Assessment (PISA) Results from PISA 2018. https://www.oecd.org/pisa/publications/PISA2018_CN_TUR.pdf
- Olukcu, E., & Yıldız, D. (2022). Examining Turkish textbooks in the context of high-level thinking skills concepts. Karaelmas Journal of Educational Sciences, 10(2), 224-246.
- Oo, T. Z., & Habók, A. (2022). Reflection-based questioning: Aspects affecting Myanmar students’ reading comprehension. Heliyon, 8(7), e09864. https://doi.org/10.1016/j.heliyon.2022.e09864
- Özdemir, O. (2019). Türkçe öğretme ve öğrenmenin anlamı [The meaning of teaching and learning Turkish]. K. Bulut ve M. N. Kardaş (Ed.) Türkçe öğrenme ve öğretim yaklaşımları [Turkish learning and teaching approaches] (ss. 59-86). Pegem Publishing.
- Özdemir, O. (2020). A higher order thinking skill to be developed in Turkish language teaching: Analytical thinking. Journal of Mother Tongue Education, 8(3), 950-971. https://doi.org/10.16916/aded.751287
- Özen, O. (2020). Examining the openended question preparation skills of Turkish teachers (Publication No.633491) [Master’s thesis, Atatürk University]. Council of Higher Education Thesis Center.
- Parker, M., & Hurry, J. (2007). Teachers’ use of questioning and modelling comprehension skills in primary classrooms. Educational Review, 59(3), 299–314. https://doi.org/10.1080/00131910701427298
- Paul, R. W., & Elder, L. (2007). The thinker’s guide to analytic thinking. Foundation for Critical Thinking.
- Ratnapalan, S., & Hilliard, R. I. (2002). Needs assessment in postgraduate medical education: A review. Medical Education Online, 7(1), 4542. https://doi.org/10.3402/meo.v7i.4542
- Renaud, R. D. & Murray, H. G. (2007). The validity of higher-order questions as a process indicator of educational quality. Research in Higher Education, 48, 319–351. http://dx.doi.org/10.1007/s11162-006-9028-1
- Resnick, L. (1987). Education and learning to think. National Academy Press.
- Rodríguez, D., Carrasquillo, A., & Lee, K. S. (2014). The bilingual advantage: Promoting academic development, biliteracy, and native language in the classroom. Teachers College Press.
- Sallabaş, M. E., & Yılmaz, G. (2020). Review of text-dependent questions in Turkish textbook according to revised Bloom’s taxonomy. Journal of Mother Tongue Education, 8(2), 586-596. https://doi.org/10.16916/aded.679933
- Seeger, V., Wood, S., & Romans, D. (2018). Questioning for meaning: Enhancing questioning strategies of teacher candidates through the understanding by design approach. College Quarterly, 21(3), 3-15.
- Seibert, S. A. (2023). Scaffolding questions to foster higher order thinking. Teaching and Learning in Nursing, 18(1), 185-187. https://doi.org/10.1016/j.teln.2022.09.008
- Sezgin, Z., & Özilhan, Y. (2019). Examining text-based comprehension questions in Turkish textbooks of the 1st- the 8st graders. Journal of Mother Tongue Education, 7(2), 353-367. https://doi.org/10.16916/aded.530191
- Shahrill, M., & Clarke, D. J. (2014). Brunei teachers’ perspectives on questioning: Investigating the opportunities to ‘talk’ in mathematics lessons. International Education Studies, 7(7), 1-18. http://dx.doi.org/10.5539/ies.v7n7p1
- Söylemez, Y. (2018). 2018 Evulation of the acquisitions in the 2018 Turkish language teaching program in terms of the high-level thinking skills. Atatürk University Journal of Turkish Research Institute, 63, 345-384. https://doi.org/10.14222/Turkiyat3991
- Tsai, P., Tsai, C., & Hwang, G. (2011). Developing a survey for assessing preferences in constructivist context-aware ubiquitous learning environments. Journal of Computer Assisted Learning, 28(3), 250–264. https://doi.org/10.111 1/j.1365-2729.2011.00436.x.
- Usta, H. G. (2022). Writing test items to evaluate higher order thinking of school teachers. Inonu University Journal of the Faculty of Education, 23(1), 486-514. https://doi.org/10.17679/inuefd.986355
- Whorf, B. (1940). Linguistics as an exact science. Technology Review, 43(1), 61-63,80-83.
- Wilen, W. W., & Clegg, A. (1986). Effective questions and questioning: A research review. Theory and Research in Social Education, 14(2), 153-162. https://doi.org/10.1080/00933104.1986.10505518
- Wimer, J. W., Ridenour, C. S., Thomas, K., & Place, W. A. (2001) Higher order teacher questioning of boys and girls in elementary mathematics classrooms. The Journal of Educational Research, 95(2), 84-92. https://doi.org/10.1080/00220670109596576
- Yıldız, D. (2021). Turkish and Turkish language and literature teachers’ views’ on the reading skills and turkey's performance in PISA: A focus group interview. Journal of Qualitative Research in Education, 27, 208-231. https://doi.org/10.14689/enad.27.10
- Yıldız, D., Divrik, D., Özçelik, B., & Aktaş, A. T. (2022). Investigation of high level reading comprehension skills of secondary school students. Journal of Mother Tongue Education, 10(3), 575-597. https://doi.org/10.16916/aded.1104406
- Yıldız, D., Ünal, A. V., Bayrakçı, M. R., & Polat, M. (2019). High-Level reading comprehension skills: A research on developing an achievement test. Journal of Education and Humanities: Theory and Practice, 10(20), 2-22.
- Yip, D. Y. (2004). Questioning skills for conceptual change in science instruction. Journal of Biological Education, 38(2), 76-83. https://doi.org/10.1080/00219266.2004.9655905
- Zhou, Y., Gan, L., Chen, J., Wijaya, T. T., & Li, Y. (2023). Development and validation of a higher-order thinking skills assessment scale for pre-service teachers. Thinking Skills and Creativity, 48, 101272. https://doi.org/10.1016/j.tsc.2023.101272
Türkçe Öğretmenlerinin Üst Düzey Soru Hazırlama Yeterlikleri
Yıl 2024,
Cilt: 25 Sayı: 2, 1173 - 1216, 30.08.2024
Tuba Acar Erdol
,
Emel Bayrak Özmutlu
,
Pınar Kanık Uysal
,
Çiğdem Akın Arıkan
Öz
Bu çalışmanın amacı, ana dili öğretmenlerinin üst düzey soru hazırlama yeterliliklerini incelemektir. Betimsel bir araştırma olarak tasarlanan bu çalışma, doküman analizi yöntemiyle gerçekleştirilmiştir. Araştırmanın verilerini Türkiye'nin orta ölçekli bir ilindeki ortaokullarda görev yapan anadili öğretmenlerinin hazırladığı sorular oluşturmaktadır. Veri toplama aracı olarak araştırmacılar tarafından geliştirilmiş olan üst düzey soru hazırlama yönergesi kullanılmış, araştırmanın analizleri iki aşamada gerçekleştirilmiştir. İlk aşamada sorular Yenilenmiş Bloom Taksonomisi bağlamında incelenmiş, ikinci aşamada ise üst düzey düşünme becerisini ölçmeyi hedeflediğine karar verilen soruların hangi düşünme becerilerini ölçtüğünü belirlemek için kategorik içerik analizi yapılmıştır. Araştırma bulguları, öğretmenler tarafından yazılan soruların yalnızca %12,8'inin üst düzey düşünme becerilerini ölçtüğünü göstermiştir. Öğretmenler tarafından hazırlanan soruların büyük ölçüde anlam temelli yapılandırma, çıkarım, karşılaştırma ve uygulama düşünme becerilerini ölçmeye odaklandığı; öz değerlendirme, problem çözme, tartışma, sıralama ve sorgulama becerilerini ölçmede yetersiz kaldığı tespit edilmiştir. Bu araştırma öğretmenlerin üst düzey düşünmeye yönelik soru yazmada zorlandıklarını ve buna yönelik eğitim ihtiyaçları olduğunu ortaya koymuştur.
Destekleyen Kurum
Ordu University’s Scientific Research Comity
Kaynakça
- Acar-Erdol, T. (2020). Analysis of the questions in 11th Grade Philosophy Coursebook in terms of higher-order thinking skills. Turkish Journal of Education, 9(3), 222-245. https://doi.org/10.19128/turje.695928
- Acar-Erdol, T. (2022). Teaching collaborative problem solving skills, M. K. Yöntem (Ed.). Effective university education with practical examples, (pp. 133-160). Eğitim Publishing.
- Airasian, P. W., & Russell, M. K. (2008). Classroom assessment concepts and applications. McGraw-Hill Education.
- Akyol, H., Yıldırım, K. , Ateş, S., & Çetinkaya, Ç. (2013). What kinds of questions do we ask for making meaning? Mersin University Journal of Faculty Education, 9(1), 41-56.
- Altun, K. (2021). Examination of the theme evaluation questions in 8th-grade Turkish textbook according to PISA levels and Revised Bloom Taxonomy (Publication No.675192) [Master Thesis, Necmettin Erbakan University]. Council of Higher Education Thesis Center.
- Anderson, D. K., Schoenleber, M., & Korshavn, S. (2023). Higher-Order Clicker Questions Engage Students and Prepare Them for Higher-Order Thinking Activities. Journal of Microbiology & Biology Education, 24(1), e00151-22. https://doi.org/10.1128/jmbe.00151-22
- Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of educational objectives. Longman.
- Arap, B. (2015). Examination of the questions used by secondary school turkish teachers for text processing process: a case study [Unpublished master's thesis]. Çanakkale Onsekiz Mart University.
- Assaly, I., & Jabarin, A. (2021). Arab Israeli EFL teachers’ perceptions and practices vis-à-vis teaching higher-order thinking skills: A complicated relationship. Language Teaching Research, 0(0). https://doi.org/10.1177/13621688211032426
- Ateş, S. (2013). Eleştirel okuma ve bir beceri olarak öğretimi. Turkish Journal of Education, 2(3), 40-49. https://doi.org/10.19128/turje.181063
- Ateş, S., Güray, E., Döğmeci, Y., & Gürsoy, F. F. (2016). Comparison of questions of teachers and students in terms of level. Research in Reading & Writing Instruction, 4(1), 1-13. https://dergipark.org.tr/tr/pub/oyea/issue/27301/287409
- Aydemir, Y., & Çiftçi, Ö. (2008). A research on asking question ability of literature teacher candidates (Gazi University education faculty pattern). Van Yüzüncü Yıl University Journal of Education, 5(2), 103 115. https://dergipark.org.tr/tr/pub/yyuefd/issue/13714/
- Barnett, J. E., & Francis, A. L. (2012). Using higher order thinking questions to foster critical thinking: a classroom study. Educational Psychology, 32(2), 201-211. http://dx.doi.org/10.1080/01443410.2011.638619
- Batur, Z., & Ulutaş, M. (2013). An analyze of th correspondence levels between Turkish reading proficiency objectives and the PISA scale. International Journal of Social Science, 6(2), 1549-1563. https://doi.org/10.9761/jasss_651
- Bayrak-Özmutlu, E. (2020). The distribution of the mother tongue curricula learning outcomes based on the thinking skills. Cukurova University Faculty of Education Journal, 49 (1), 185-224. https://dergipark.org.tr/en/pub/cuefd/issue/53758/623935
- Bayrak Özmutlu, E. & Kanık Uysal, P. (2021). Investigation of activities in turkish textbooks in terms of thinking skills. Pamukkale University Journal of Education, 52, 518-543. https://10.9779/pauefd.745469
- Baysen, E. (2006). The levels of teacher questions and student answers. Kastamonu Education Journal, 14(1), 21-28. https://dergipark.org.tr/en/pub/kefdergi/issue/49106/626652
- Belet Boyacı, Ş. D., & Güner Özer, M. (2019). The future of learning: Turkish language course curricula from the perspective of 21st century skills. Anadolu Journal of Educational Sciences International, 9(2), 708-738. https://doi.org/10.18039/ajesi.578170
- Benzer, A. (2019). Challenge PISA reading proficiency levels of turkish textbooks. Research in Reading & Writing Instruction, 7(2), 96-109. https://doi.org/10.35233/oyea.659740
- Blything, L. P., Hardie, A., & Cain, K. (2019). Question asking during reading comprehension instruction: a corpus study of how question type influences the linguistic complexity of primary school students’ responses. Reading Research Quarterly, 55(3), 443-472. https://doi.org/10.1002/rrq.279
- Bono, E. D. (2013). Kendine düşünmeyi öğret [Teach yourself to think] (S. Arıbaş, Trans.). Remzi Publishing (Original work published 2009).
- Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27-40. https://doi.org/10.3316/QRJ0902027
- Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.
- Bür, B. (2014). A study of teacher questions: Do they promote critical thinking? (Publication No. 381545) [Master Thesis, Gazi University]. Council of Higher Education Thesis Center.
- Büyükalan Filiz, S. (2007). Öğretmenler için soru sorma sanatı [Art of asking questions for teachers]. Nobel Publishing.
- Büyükalan Filiz, S., & Yıldırım, N. (2019). Analysis of secondary-school Turkish course curriculum objectives according to revised Bloom taxonomy. Elemantry Education Online, 18(4), 1550-1573. https://doi.org/10.17051/ilkonline.2019.632521
- Büyüköztürk, Ş., Çakmak, E., Akgün, Ö., Karadeniz, Ş., & Demirel, F. (2012). Bilimsel araştırma yöntemleri [Methods of scientific research]. Pegem Publishing.
- Chen, Y. (2019). Developing students’ critical thinking and discourse level writing skill through teachers’ questions: A sociocultural approach. Chinese Journal of Applied Linguistics, 42(2), 141-162. https://doi.org/10.1515/CJAL-2019-0009
- Collins, R. (2014). Skills for the 21st Century: teaching higher-order thinking. Curriculum & Leadership Journal, 12(14).
- Corbin, J., & Strauss, A. (2008). Qualitative research, Sage.
- Çakır, N. (2013). The effect of university education on the development of higher order thinking skills (Publication No. 363194) [Doctoral dissertation, Hacettepe University]. Council of Higher Education Thesis Center.
- Çerçi, A. (2018). Investigation of 2018 Turkish language curriculum (5, 6, 7, 8th grade) according to revised Bloom Taxonomy. Research in Reading & Writing Instruction, 6(2), 70-81. https://dergipark.org.tr/en/pub/oyea/issue/42065/487733
- Çintaş Yıldız, D. (2015). The analysis of Turkish course exam questions according to re-constructed bloom’s taxonomy. Gaziantep University Journal of Social Sciences, 14(2), 479-497. https://doi.org/10.21547/jss.256771
- Davoudi, M., & Sadeghi, N. A. (2015). A systematic review of research on questioning as a high-level cognitive strategy. English Language Teaching, 8(10), 76-90. http://dx.doi.org/10.5539/elt.v8n10p76
- DeJarnette, A. F., Wilke, E., & Hord, C. (2020). Categorizing mathematics teachers’ questioning: The demands and contributions of teachers’ questions. International Journal of Educational Research, 104, 101690. https://doi.org/10.1016/j.ijer.2020.101690
- Demirel, G., & Yağmur, K. (2017). An evaluation of Turkish children’s higher order thinking skills based on the international PIRLS applications Standards. Journal of Language Education and Research, 3(2), 95-106. http://dergipark.gov.tr/jlere
- Deniz, K., & Keray Dinçel, B. (2019). Turkish language teachers’ opinions about the assessment and evaluation of comprehension skills. Journal of Mother Tongue Education, 7(1), 28-64. https://doi.org/10.16916/aded.448811
- Dickey, A. B. (2018). A Quasi-experimental study of the use of higher-order questions to improve reading comprehension in beginning readers (Publication No.13425658) [Doctoral dissertation, Northcentral University]. ProQuest Dissertations and Theses Global.
- Durgun, E., & Önder, İ. (2019). The relationship of science achievement with reading comprehension, graphic reading, problem-solving skills in middle school seventh-grade students. Journal of Individual Differences in Education, 1(1), 1-13.
- Elder, L., & Paul, R. (1998). The role of Socratic questioning in thinking, teaching, and learning. The Clearing House, 71(5), 297-301. https://doi.org/10.1080/00098659809602729
- Erdoğan, T. (2017). The view of primary school fourth grade students and teachers’ questions about Turkish language lessons in the terms of the revised Bloom taxonomy. Education and Science, 42(192). https://doi.org/10.15390/eb.2017.7407
- Erman Aslanoğlu, A. (2022). Üst düzey zihinsel beceriler ve ölçülmesi [Higher order cognitive skills and measurement]. İ. Karakaya (Ed.). Açık uçlu soruların hazırlanması, uygulanması ve değerlendirilmesi [Preparation, implementation and evaluation of open-ended questions] (pp.1-26). Pegem Publishing.
- Forster, M. (2004). Higher order thinking skills. Research Developments. 11(1), 10-15.
- Fusco, E. (2015). Effective questioning strategies in the classroom. Teachers College.
- Geisinger, K. F. (2016). 21st century skills: what are they and how do we assess them?, Applied Measurement in Education, 29(4), 245-249. https://doi.org/10.1080/08957347.2016.1209207
- Güfta, H., & Zorbaz, K. Z. (2008). A review regarding levels of written examination questions for Turkish courses of the secondary school. Journal of the Cukurova University Institute of Social Sciences, 17(2), 205-218.
- Haladyna, T. M. (1997). Writing test items to evaluate higher order thinking. Allyn and Bacon.
- Hwang, G., Lai, C., Liang, J., Chu, H., & Tsai, C. (2017). A long-term experiment to investigate the relationships between high school students’ perceptions of mobile learning and peer interaction and higher-order thinking tendencies. Educational Technology Research and Development, 66(1), 75–93. https://doi.org/10.1007/s11423-017-9540-3
- Işır, E., & Uyar, Y. (2022). Investigating reading comprehension questions and student-generated questions in language lessons in terms of level. Education Quarterly Reviews, 5(4), 440-455. https://doi.org/10.31014/aior.1993.05.04.676
- İnceçam, B., Demir, E., & Demir, E. (2018). Competencies of middle school teachers to prepare open-ended items used in open-ended test for in-classroom assessment. Elementary Education Online, 17(4) 1912-1927. https://doi.org/10.17051/ilkonline.2019.506900
- İstanbullu, E. (2021). The effect of questioning teaching for reading literacy on PISA-style questioning of pre-service Turkish language teachers (Publication No.674911) [Master’s thesis, Uludağ University]. Council of Higher Education Thesis Center.
- Jansen, T., & Möller, J. (2022). Teacher judgments in school exams: Influences of students' lower-order-thinking skills on the assessment of students’ higher-order-thinking skills. Teaching and Teacher Education, 111, 103616. https://doi.org/10.1016/j.tate.2021.103616
- Kanık Uysal, P. (2022). Examination of Questions in Turkish Lesson Exam Papers in Terms of Higher-Order Thinking Skills. Journal of Mother Tongue Education, 10(1), 136-156. https://doi.org/10.16916/aded.1016659
- Kanık-Uysal, P., Akın-Arıkan, Ç., Acar-Erdol, T., Bayrak-Özmutlu, E., & Akyol, H. (2022). Examining Turkish course exam questions in terms of originality, page layout, item type, item writing criteria and cognitive level. Education and Science, 47(210), 259-280. https://doi.org/10.15390/EB.2022.10896
- Karatay, H., & Dilekçi, A. (2019). Competencies of Turkish teachers in measuring and evaluating language skills. Milli Eğitim Dergisi, 48(1), 685-716. https://dergipark.org.tr/tr/pub/milliegitim/issue/51765/674598
- Kavruk, H., & Çeçen, M. A. (2013). Evaluation of Turkish language class exam questions in point of cognitive field levels. Journal of Mother Tongue Education, 1(4), 1-9. https://doi.org/10.16916/aded.15990
- Kelley Mudie, S., & Phillips, J. (2016). To build a better question. Knowledge Quest, 44(5), 14-19.
- Krause, U., Béneker, T., van Tartwijk, J., & Maier, V. (2021) ‘Curriculum contexts, recontextualisation and attention for higher-order thinking’. London Review of Education, 19(1), 24, 1–17. https://doi.org/10.14324/LRE.19.1.24
- Ömeroğlu, A. F. (2024). Examination of the Exam Questions Used by Turkish Language Teachers in Terms of Learning Areas, Measurement and Evaluation Methods, and Cognitive Domain Levels. The Journal of International Language, Literature, Culture, History, Art and Education Research, 14, 975-992. https://10.51531/korkutataturkiyat.1398820
- Kutlu, Ö., & Altıntaş, Ö. (2021). A brief history of psychological measurements and an approach of classroom assessment in the 21st century. Trakya Journal of Education, 11(3), 1599-1620. https://doi.org/10.24315/tred.896121
- Lee, Y., & Kinzie, M. B. (2012). Teacher question and student response with regard to cognition and language use. Instructional Science, 40, 857-874. https://doi.org/10.1007/s11251-011-9193-2
- Lewis, A., & Smith, D. (1993). Defining higher order thinking, Theory Into Practice, 32(3), 131-137. https://doi.org/10.1080/00405849309543588
- Liu, Q., Wald, N., Daskon, C., & Harland, T. (2023). Multiple-choice questions (MCQs) for higher-order cognition: Perspectives of university teachers. Innovations in Education and Teaching International, 1-13. https://doi.org/10.1080/14703297.2023.2222715
- Loyens, S. M., Van Meerten, J. E., Schaap, L., & Wijnia, L. (2023). Situating higher-order, critical, and critical-analytic thinking in problem-and project-based learning environments: A systematic review. Educational Psychology Review, 35(2), 39. https://doi.org/10.1007/s10648-023-09757-x
- Lu, K., Yang, H. H., Shi, Y., & Wang, X. (2021). Examining the key influencing factors on college students’ higher-order thinking skills in the smart classroom environment. International Journal of Educational Technology in Higher Education, 18(1), 1-13. https://doi.org/10.1186/s41239-020-00238-7
- Maden, S., & Durukan, E. (2009). Assessing types, taxonomy and learning subjects of Turkish lesson esssay questions. Atatürk University Journal of Kazım Karabekir Education Faculty, 19, 95-115.
- Magnusson, C. G. (2022). Reading literacy practices in Norwegian lower-secondary classrooms: Examining the patterns of teacher questions. Scandinavian Journal of Educational Research, 66(2), 321-335. https://doi.org/10.1080/00313831.2020.1869078
- McMillan, J. H. (2015). Sınıf içi değerlendirme, etkili ölçütlere dayalı etkili bir öğretim için ilke ve uygulamalar [Classroom assessment, principles and practices for effective instruction]. (A. Arı, Trans Ed.). Eğitim Publishing.
- Milawati, M., & Suryati, N. (2019). EFL teacher’s oral questioning: Are her questions and strategies effective?. Dinamika Ilmu, 19(1), 37-55. https://doi.org/10.21093/di.v19i1.1545
- MoNE. (2017). Öğretmenlik Mesleği Genel Yeterlikleri [General Competencies for Teaching Profession]. https://oygm.meb.gov.tr/meb_iys_dosyalar/2017_12/11115355_YYRETMENLYK_MESLEYY_GENEL_YETERLYKLERY.pdf
- MoNE. (2018). 2023 Eğitim Vizyonu. https://www.gmka.gov.tr/dokumanlar/yayinlar/2023_E%C4%9Fitim%20Vizyonu.pdf
- MoNE. (2019). Türkçe Deri Öğretim Programı (İlkokul ve Ortaokul 1, 2, 3, 4, 5, 6, 7 ve 8. Sınıflar) [Turkish Language Teaching Program (Primary and Secondary School Grades 1, 2, 3, 4, 5, 6, 7 and 8)]. http://mufredat.meb.gov.tr/ProgramDetay.aspx?PID=663
- Moodley, V. (2013). In-service teacher education: Asking questions for higher order thinking in visual literacy. South African Journal of Education, 33(2), 1-18.
- Newmann, F. M. (1988). Higher order thinking in the high school curriculum. NASSP Bulletin, 72(508), 58–64. https://doi.org/10.1177/019263658807250812
- Newmann, F. M. (1990). Higher order thinking in teaching social studies: A rationale for the assessment of classroom thoughtfulness. Journal of Curriculum Studies, 22(1), 41-56.
- OECD (2018). The future of education and skills Education 2030. https://www.oecd.org/education/2030/E2030%20Position%20Paper%20(05.04.2018).pdf
- OECD (2019a). PISA 2018 results volume I: What students know and can do. OECD Publishing.
- OECD (2019b). Country Note: Turkey, Programme For International Student Assessment (PISA) Results from PISA 2018. https://www.oecd.org/pisa/publications/PISA2018_CN_TUR.pdf
- Olukcu, E., & Yıldız, D. (2022). Examining Turkish textbooks in the context of high-level thinking skills concepts. Karaelmas Journal of Educational Sciences, 10(2), 224-246.
- Oo, T. Z., & Habók, A. (2022). Reflection-based questioning: Aspects affecting Myanmar students’ reading comprehension. Heliyon, 8(7), e09864. https://doi.org/10.1016/j.heliyon.2022.e09864
- Özdemir, O. (2019). Türkçe öğretme ve öğrenmenin anlamı [The meaning of teaching and learning Turkish]. K. Bulut ve M. N. Kardaş (Ed.) Türkçe öğrenme ve öğretim yaklaşımları [Turkish learning and teaching approaches] (ss. 59-86). Pegem Publishing.
- Özdemir, O. (2020). A higher order thinking skill to be developed in Turkish language teaching: Analytical thinking. Journal of Mother Tongue Education, 8(3), 950-971. https://doi.org/10.16916/aded.751287
- Özen, O. (2020). Examining the openended question preparation skills of Turkish teachers (Publication No.633491) [Master’s thesis, Atatürk University]. Council of Higher Education Thesis Center.
- Parker, M., & Hurry, J. (2007). Teachers’ use of questioning and modelling comprehension skills in primary classrooms. Educational Review, 59(3), 299–314. https://doi.org/10.1080/00131910701427298
- Paul, R. W., & Elder, L. (2007). The thinker’s guide to analytic thinking. Foundation for Critical Thinking.
- Ratnapalan, S., & Hilliard, R. I. (2002). Needs assessment in postgraduate medical education: A review. Medical Education Online, 7(1), 4542. https://doi.org/10.3402/meo.v7i.4542
- Renaud, R. D. & Murray, H. G. (2007). The validity of higher-order questions as a process indicator of educational quality. Research in Higher Education, 48, 319–351. http://dx.doi.org/10.1007/s11162-006-9028-1
- Resnick, L. (1987). Education and learning to think. National Academy Press.
- Rodríguez, D., Carrasquillo, A., & Lee, K. S. (2014). The bilingual advantage: Promoting academic development, biliteracy, and native language in the classroom. Teachers College Press.
- Sallabaş, M. E., & Yılmaz, G. (2020). Review of text-dependent questions in Turkish textbook according to revised Bloom’s taxonomy. Journal of Mother Tongue Education, 8(2), 586-596. https://doi.org/10.16916/aded.679933
- Seeger, V., Wood, S., & Romans, D. (2018). Questioning for meaning: Enhancing questioning strategies of teacher candidates through the understanding by design approach. College Quarterly, 21(3), 3-15.
- Seibert, S. A. (2023). Scaffolding questions to foster higher order thinking. Teaching and Learning in Nursing, 18(1), 185-187. https://doi.org/10.1016/j.teln.2022.09.008
- Sezgin, Z., & Özilhan, Y. (2019). Examining text-based comprehension questions in Turkish textbooks of the 1st- the 8st graders. Journal of Mother Tongue Education, 7(2), 353-367. https://doi.org/10.16916/aded.530191
- Shahrill, M., & Clarke, D. J. (2014). Brunei teachers’ perspectives on questioning: Investigating the opportunities to ‘talk’ in mathematics lessons. International Education Studies, 7(7), 1-18. http://dx.doi.org/10.5539/ies.v7n7p1
- Söylemez, Y. (2018). 2018 Evulation of the acquisitions in the 2018 Turkish language teaching program in terms of the high-level thinking skills. Atatürk University Journal of Turkish Research Institute, 63, 345-384. https://doi.org/10.14222/Turkiyat3991
- Tsai, P., Tsai, C., & Hwang, G. (2011). Developing a survey for assessing preferences in constructivist context-aware ubiquitous learning environments. Journal of Computer Assisted Learning, 28(3), 250–264. https://doi.org/10.111 1/j.1365-2729.2011.00436.x.
- Usta, H. G. (2022). Writing test items to evaluate higher order thinking of school teachers. Inonu University Journal of the Faculty of Education, 23(1), 486-514. https://doi.org/10.17679/inuefd.986355
- Whorf, B. (1940). Linguistics as an exact science. Technology Review, 43(1), 61-63,80-83.
- Wilen, W. W., & Clegg, A. (1986). Effective questions and questioning: A research review. Theory and Research in Social Education, 14(2), 153-162. https://doi.org/10.1080/00933104.1986.10505518
- Wimer, J. W., Ridenour, C. S., Thomas, K., & Place, W. A. (2001) Higher order teacher questioning of boys and girls in elementary mathematics classrooms. The Journal of Educational Research, 95(2), 84-92. https://doi.org/10.1080/00220670109596576
- Yıldız, D. (2021). Turkish and Turkish language and literature teachers’ views’ on the reading skills and turkey's performance in PISA: A focus group interview. Journal of Qualitative Research in Education, 27, 208-231. https://doi.org/10.14689/enad.27.10
- Yıldız, D., Divrik, D., Özçelik, B., & Aktaş, A. T. (2022). Investigation of high level reading comprehension skills of secondary school students. Journal of Mother Tongue Education, 10(3), 575-597. https://doi.org/10.16916/aded.1104406
- Yıldız, D., Ünal, A. V., Bayrakçı, M. R., & Polat, M. (2019). High-Level reading comprehension skills: A research on developing an achievement test. Journal of Education and Humanities: Theory and Practice, 10(20), 2-22.
- Yip, D. Y. (2004). Questioning skills for conceptual change in science instruction. Journal of Biological Education, 38(2), 76-83. https://doi.org/10.1080/00219266.2004.9655905
- Zhou, Y., Gan, L., Chen, J., Wijaya, T. T., & Li, Y. (2023). Development and validation of a higher-order thinking skills assessment scale for pre-service teachers. Thinking Skills and Creativity, 48, 101272. https://doi.org/10.1016/j.tsc.2023.101272