DELPHİ TEKNİĞİ UYGULAMA SÜRECİNE YÖNELİK ÖRNEK BİR ÇALIŞMA: ÇOK FONKSİYONLU TARIM OKURYAZARLIĞI

Abstract

Bu çalışmanın amacı, farklı alanlardan uzmanların uyum içerisinde sürece dahil oldukları veri toplama yaklaşımlarından biri olan Delphi Tekniğinin i) kısa tarihçesi, kullanıldığı alanlar, avantaj ve dezavantajları ile hizmet ettiği amaçlar hakkında genel bilgi vermek, ii) uygulama sürecinde yer alan uzmanların oluşturulma kriterlerini ve veri toplama sürecini aşamalı bir şekilde aktarmak, iii) her bir Delphi turunda yapılabilecek veri analizlerini, Çok Fonksiyonlu Tarım Okuryazarlığı çalışmasında deneyimlenen süreç üzerinden açıklamaktır. Çalışma, ulusal ve uluslararası alanyazında Delphi Tekniğini kullanmak isteyen araştırmacılara kaynak oluşturması, süreçte karşılaşılan problemler ve bu problemlere çözüm önerileri sunması açısından önemli olmasının yanı sıra, tekniği kullanacak olan araştırmacılara pratik ve sistematik bir yaklaşım da sunmaktadır.

Keywords

• Delphi (Delfi) tekniği
• metodoloji
• konsensüs
• standartlar
• uzman
• çok fonksiyonlu tarım okuryazarlığı

A CASE STUDY REGARDING THE APPLICATION PROCESS OF DELPHI TECHNIQUE: MULTI-FUNCTIONAL AGRICULTURE LITERACY

Abstract

The purpose of the study is i) to give general information about the brief history, areas of use, advantages and disadvantages of the Delphi technique, which is one of the data collection approaches that include experts from different fields in the process in harmony, and the purposes it serves, ii) to state the criteria to determine the experts who are included in the application process of the technique and the data collection process of the technique in stages, iii) to explain the data analyses to be performed in each Delphi round over the process experienced in the Multi-Functional Agricultural Literacy study. In addition to being important in respect of creating resources for researchers who want to use the Delphi Technique in the national and international literature, the problems faced in the process and proposing solutions to these problems, the study also offers a practical and systematic approach for the researchers who are going to use the technique.

Keywords

• Delphi technique
• methodology
• consensus
• standards
• expertise
• multi-functional agricultural literacy

References

1. Armstrong, J. S. (2001). Principles of forecasting: A handbook for researchers andpractitioners. Kluwer Academic Publishers.
2. Belton, I., MacDonald, A., Wright, G., & Hamlin, I. (2019). Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process. Technological Forecasting and Social Change, 147, 72-82. https://doi.org/10.1016/j.techfore.2019.07.002
3. Bolger, F., & Wright, G. (2011). Improving the Delphi process: Lessons from social psychological research. Technological Forecasting and Social Change, 78(9), 1500-1513. https://doi.org/10.1016/j.techfore.2011.07.007
4. Brockhoff, K. (1975). The performance of forecasting groups in computer dialogue and face-to-face discussion. The Delphi Method: Techniques and Applications, 68, 291-321.
5. Cicchetti, D. V., Shoinralter, D., & Tyrer, P. J. (1985). The effect of number of rating scale categories on levels of interrater reliability: A Monte Carlo investigation. Applied Psychological Measurement, 9(1), 31-36. https://doi.org/10.1177/014662168500900103
6. Clayton, M. J. (1997). Delphi: A technique to harness expert opinion for critical decision‐making tasks in education. Educational Psychology, 17(4), 373-386. https://doi.org/10.1080/0144341970170401
7. Cochran, S. W. (1983). The Delphi method: Formulating and refining group judgments. Journal of Human Sciences, 11(2), 111-117.
8. Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches (3rd ed.). Sage Publications.

9. Creswell, J. W., & Clark, V. L. P. (2007). Designing and conducting mixed methods research. Sage Publications.
10. Dalkey, N. C. (2002). Toward a theory of group estimation. In H. A. Linstone & M. Turoff (Eds.), The Delphi method: Techniques and applications (pp. 231-256). https://doi.org/10.1287/mnsc.9.3.45
11. Dalkey, N. C., & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458–467. https://doi.org/10.1287/mnsc.9.3.458
12. Delbecq, A. L., Van de Ven, A. H., & Gustafson, D. H. (1975). Group techniques for program planning: A guide to nominal group and Delphi processes. Scott, Foresman & Company.
13. Devaney, L., & Henchion, M. (2018). Consensus, caveats and conditions: International learnings for bioeconomy development. Journal of Cleaner Production, 174, 1400-1411. https://doi.org/10.1016/j.jclepro.2017.11.047
14. Eggers, R. M., & Jones, C. M. (1998). Practical considerations for conducting Delphi studies: The oracle enters a new age. Educational Research Quarterly, 21(3), 53–66.
15. Fish, L. S., & Busby, D. M. (1996). The Delphi method. In D. H. Sprenkle & S. M. Moon (Eds.), Research methods in family therapy (pp. 469-482). Guilford Press.
16. Franklin, K. K., & Hart, J. K. (2007). Idea generation and exploration: Benefits and limitations of the policy delphi research method. Innovative Higher Education, 1, 237–246.
17. Frick, M. J. (1990). A defination and the concepts of agricultural literacy: A nationalstudy [Unpublish doctoral dissertation]. Iowa State University.
18. Frick, M. J., Kahler, A. A., & Miller, W. W. (1991). A definition and the concepts ofagricultural literacy. Journal of Agricultural Education, 32(2), 49-57. https://doi.org/10.5032/jae.1991.02049
19. Fry, M., & Burr, G. (2001). Using the Delphi tecnique to design a self reporting triage survey tool. Accident and Emergency Nursing, 9(4), 235- 241. https://doi.org/10.1054/aaen.2001.0245
20. Furr, R. M. (2011). Scale construction and psychometrics for social and personality psychology. Sage Publications.
21. Galloway, R. (1999). Desired characteristics of park and recreation executive board members: A delphi study [Unpublished doctoral dissertation]. Texas A&M University-Commerce.
22. Garavalia, L., & Gredler, M. (2004). Teaching evaluation through modeling: Using the Delphi technique to access problems in academic programs. American Journal of Evaluation, 25(3), 375–380. https://doi.org/10.1177/109821400402500307
23. Garrod, B., & Fyall, A. (2005). Revisiting Delphi: The Delphi technique in tourism research. In B. W. Ritchie, P.
24. Burns & C. Palmer (Eds.), Tourism research methods: Integrating theory with practice (pp. 85-98). CABI Publishing.
25. Gordon, T. J. (1994). The Delphi method. AC/UNU Millennium Project: Futures Research Methodology, 2(3), 1-30.
26. Grisham, T. (2008). The Delphi technique: A method for testing complex andmultifaceted topics. International Journal of Managing Projects in Business, 2(1), 112-130. https://doi.org/10.1108/17538370910930545
27. Gürel, D. A. (2010). Participation in service design: An example of a hotel management [Unpublished doctoral dissertation]. Anadolu University.
28. Hartman, A. (1981). Reaching consensus using the Delphi technique. Educational Leadership, 38(6), 495-497.
29. Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 32(4), 1008-1015. https://doi.org/10.1046/j.1365-2648.2000.t01-1-01567.x
30. Hatcher, T., & Colton, S. (2007). Using the internet to improve HRD research: The case of the web-based Delphi research technique to achieve content validity of an HRD-oriented measurement. Journal of European Industrial Training, 31(7), 570-587.
31. Hsu, C. C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research & Evaluation, 12(10), 1-8. https://doi.org/10.7275/pdz9-th90
32. Hung, H. L., Altschuld, J. W., & Lee, Y. F. (2008). Methodological and conceptual ıssues confronting a cross-country Delphi study of educational program valuation. Evaluation and Program Planning, 31, 191–198. https://doi.org/10.1016/j.evalprogplan.2008.02.005
33. Hussler, C., Muller, P., & Rondé, P. (2011). Is diversity in Delphi panelist groups useful? Evidence from a French forecasting exercise on the future of nuclear energy. Technological Forecasting and Social Change, 78(9), 1642-1653. https://doi.org/10.1016/j.techfore.2011.07.008
34. İçöz, O. (2005). Turizm ekonomisi (3. Baskı). Turhan Kitabevi.
35. Keeney, S., Hasson, F., & McKenna, H. (2006). Consulting the oracle: Ten lessonsfrom using the Delphi technique in nursing research. Journal of Advanced Nursing, 53(2), 205–212. https://doi.org/10.1111/j.1365-2648.2006.03716.x
36. Kuckartz, U. (2007). MAXQDA: Qualitative data analysis. VERBI software.
37. Lang, T. (1995). An overview of four futures methodologies. Manoa Journal of Fried and Half-Fried Ideas, 7, 1-43.
38. Linstone, H. A., & Turoff, M. (2002) The Delphi method: Techniques and applications. Addison-Wesley Educational Publishers Inc.
39. Loughlin, K. G., & Moore, L. F. (1979). Using Delphi to achieve congruent objectives and activities in a pediatrics department. Journal of Medical Education, 54(2), 101-106.
40. Mayring, P. (2002). Einführung in die qualitative sozialforschung (5. Auflage). Beltz Verlag.
41. MAXQDA (2015). Getting started data. http://www.maxqda.com/wp/wp-content/uploads/sites/2/Getting-StartedGuide-MAXQDA12-en.pdf
42. McKenna, H. P. (1994). The Delphi technique: A worthwhile approach for nursing? Journal of Advanced Nursing, 19, 1221-1225. https://doi.org/10.1111/j.1365-2648.1994.tb01207.x
43. Merriam, S. B. (2013). Nitel araştırma desen ve uygulama için bir rehber. (S. Turan, Çev. Ed.). Nobel Akademik Yayıncılık.
44. Miles, B. M., & Huberman, A. M. (1994). Qualitative data analysis (2nd ed.). Sage.
45. Milkovich, G. T., Annoni, A. J., & Mahoney, T. A. (1972). The use of the Delphi procedures in manpower forecasting. Management Science, 19(4), 381–388. https://doi.org/10.1287/mnsc.19.4.381
46. Mitchell, V. W. (1991). The Delphi technique: An exposition and application. Technology Analysis & Strategic Management, 3(4), 333–358. https://doi.org/10.1080/09537329108524065
47. Mullen, C. A. (2003). Guest editor’s introduction: A self-fashioned gallery of aesthetic practice. Qualitative Inquiry, 9, 165-181. https://doi.org/10.1177/1077800402250927
48. Murray, T. (1979). Delphi methodologies: A review and critique. Urban Systems, 4, 153-158. https://doi.org/10.1016/0147-8001(79)90013-5
49. Myezwa, H., Stewart, A., Solomon, P., & Becker, P. (2012). Topics on HIV/AIDS for inclusion into a physical therapy curriculum: Consensus through a modified delphi technique. Journal of Physical Therapy Education, 26(2), 50-56.
50. National Agriculture in the Clasroom (2013). Locig model for agriculture literacy programming. National Agriculture in the Classroom. https://www.agclassroom.org/get/literacy.cfm.
51. Nworie, J. (2011). Using the Delphi technique in educational technology research. TechTrends, 55(5), 24-30.
52. Okoli C., & Pawlowski, S. D. (2004). The Delphi method as a research tool: An example, design considerations and applications. Information & Management, 42, 15-29. https://doi.org/10.1016/j.im.2003.11.002
53. Patton, M. Q. (2014). Nitel araştırma ve değerlendirme yöntemleri (M. Bütün & S. B. Demir, Çev. Ed.). Pegem Akademi.
54. Paykoç, F. & Ok, A. (1990). Delfi tekniği ile Türk eğitim sistemindeki bazı problemlerin incelenmesi. Eğitim ve Bilim, 14(75), 14-21.
55. Powell, C. (2003). The Delphi technique: Myths and realities. Journal of Advanced Nursing, 41(4), 376–382. https://doi.org/10.1046/j.1365-2648.2003.02537.x
56. Price, B. (2005). Delphi survey research and older people. Nursing Older People, 17(3), 25–31. https://doi.org/10.7748/nop2005.05.17.3.25.c2373
57. Preston, C. C., & Colman, A. M. (2000). Optimal number of response categories in rating scales: Reliability, validity, discriminating power, and respondent preferences. Acta Psychologica, 104(1), 1-15. https://doi.org/10.1016/S0001-6918(99)00050-5
58. Rabiega, W. A. (1982). A classroom Delphi. Professional Geographer, 34(1), 71-79. https://doi.org/10.1111/j.0033-0124.1982.00071.x
59. Raskin, M. S. (1994). The Delphi study in field instruction revisited: Expert consensus on issues and research priorities. Journal of Social Work Education, 30(1), 75-89. https://doi.org/10.1080/10437797.1994.10672215
60. Rayens, M. K., & Hahn, E. J. (2000). Building consensus using the policy Delphi method. Policy, Politics, & Nursing Practice, 1(4), 308-315. https://doi.org/10.1111/j.0033-0124.1982.00071.x
61. Rikkonen, P., & Tapio, P. (2009). Future prospects of alternative agro-based bioenergy use in Finland- Constructing scenarios with quantitative and qualitative Delphi data. Technological Forecasting and Social Change, 76(7), 978-990. https://doi.org/10.1016/j.techfore.2008.12.001
62. Rowe, G., & Wright, G. (1999). The Delphi technique as a forecasting tool: Issues and analysis. International Journal of Forecasting, 15(4), 353-375. https://doi.org/10.1016/S0169-2070(99)00018-7
63. Sackman, H. (1975). Summary evaluation of Delphi. Policy Analysis, 1(4), 693–718.
64. Schopper, D., Ammon, C., Ronchi, A., & Rougemont, A. (2000). When providers and community leaders define health priorities: The results of a Delphi survey in the canton of Geneva. Social Sience & Medicine, 51(3), 335-342. https://doi.org/10.1016/S0277-9536(99)00457-8
65. Sharkey, S. B., & Sharples, A. Y. (2001). An approach to consensus building using the Delphi technique: Developing a learning resource in mental health. Nurse Education Today, 21(5), 398-408. https://doi.org/10.1054/nedt.2001.0573
66. Snow, C. P. (2005). İki kültür. TÜBİTAK Popüler Bilim Kitapları.
67. Skulmoski, G. J., Hartman, F. T., & Krahn, J. (2007). The Delphi method for graduate research. Journal of Information Technology Education, 6, 1-21.
68. Spickermann, A., Zimmermann, M., & Heiko, A. (2014). Surface-and deep-level diversity in panel selection, exploring diversity effects on response behaviour in foresight. Technological Forecasting and Social Change, 85, 105-120. https://doi.org/10.1016/j.techfore.2013.04.009
69. Spielmaker, D. M., & Leising, J. G. (2013). National agricultural literacy outcomes. Utah State University, School of Applied Sciences & Technology.
70. Sprenkle, D. H., & Piercy, F. P. (2005). Research methods in family therapy (2. ed.). Guilford Press.
71. Şahin, A. E. (2001). Eğitim araştırmalarında Delphi tekniği ve kullanımı. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 20(20), 215-220.
72. Şahin, A. E. (2004). Öğretmen yeterliklerinin belirlenmesi. Bilim ve Aklın Aydınlığında Eğitim Dergisi, 5(58), 58-62.
73. Tapio, P. (2003). Disaggregative policy Delphi: Using cluster analysis as a tool forsystematic scenario formation. Technological Forecasting and Social Change, 70(1), 83-101. https://doi.org/10.1016/S0040-1625(01)00177-9
74. Toma, C., & Picioreanu, I. (2016). The Delphi technique: Methodological considerations and the need for reporting guidelines in medical journals. International Journal of Public Health Research, 4(6), 47–59.
75. Turoff, M., & Hiltz, S. R. (2001). Computer based delphi processes. Kingsley.
76. Turgut, Y. (2009). Verilerin kaydedilmesi, analizi, yorumlanması: Nicel ve nitel. A. Tanrıöğen (Ed.), Bilimsel araştırma yöntemleri içinde (ss. 192-248). Anı Yayıncılık.
77. Ulschak, F. L. (1983). Human resource development: The theory and practice of needs assessment. Reston Publishing Company, Inc.
78. Vernon, W. (2009). The Delphi technique: A review. International Journal of Therapy &Rehabilitation, 16(2), 69-76. https://doi.org/10.12968/ijtr.2009.16.2.38892
79. Villiers, M. R., Villiers, P. J., & Kent, A. P. (2005). The Delphi technique in health sciences education research. Medical Teacher, 27(7), 639-643. https://doi.org/10.1080/13611260500069947
80. Weng, L. J. (2004). Impact of the number of response categories and anchor labels oncoefficient alpha and test-retest reliability. Educational Psychological Measurement, 64(6), 956–972. https://doi.org/10.1177/0013164404268674
81. West, A. (2010). Supervising counsellors and psychotherapists who work with trauma: A Delphi Study. British Journal of Guidance &Counselling, 38(4), 409-430. https://doi.org/10.1080/03069885.2010.503696
82. White, E. (1991). The future of psychiatric nursing by the year 2000: A Delphi study. Report, University of Manchester, Department of Nursing, Manchester.
83. Wiersma, W., & Jurs, S. G. (2005). Research methods in education: An Introduction (8. ed.). Pearson Education.
84. Williams, P. L., & Webb, C. (1994). The Delphi technique: A methodological discussion. Journal of Advanced Nursing, 19(1), 180-186. https://doi.org/10.1111/j.1365-2648.1994.tb01066.x
85. Witkin, B. R., & Altschuld, J. W. (1995). Planning and conducting needs assessment: A practical guide. Sage Publications, Inc.
86. Woudenberg, F. (1991). An evaluation of delphi. Technological Forecasting and Social Change, 40, 131-150. https://doi.org/10.1016/0040-1625(91)90002-W
87. Yıldırım, A. & Şimşek, H. (2008). Sosyal bilimlerde nitel araştırma (6. Baskı). Seçkin Yayınları.
88. Yousuf Muhammad, I. (2007). Using experts` opinions through delphi technique, practical assessment. Research, and Evaluation, 12(4), 1-8. https://doi.org/10.7275/rrph-t210