Content Analysis Of Research Projects Submitted 
By Undergraduate Students (2000-2009) At The 
Zimbabwe Open University: Implications For Quality Assessment

Year 2011, Volume: 12 Issue: 1, 62 - 84, 01.03.2011

Caleb Kangaı Richard Bukalıya Farirai Musıka Mapuranga Babra

Abstract

This study was part of a series of studies, into issues of quality, currently being conducted at the ZOU by the present authors. The present study aimed at developing a systematic approach towards quality assessment of students’ research work. A content analysis of 400 research projects submitted by ZOU undergraduate students between 2000-2009 was undertaken applying both conceptual and relational analysis. Conceptual analysis was based on a checklist of six concepts: research questions, research paradigm, research design, data collection instruments, data form, procedures for data analysis and presentation and sought to establish the status of students’ research work, its gaps and areas of saturation. Relational analysis was conducted through the use of a model that sought to assess the methodological appropriateness and methodological quality of the research projects. Major findings of the study revealed a clear distinction between research methodologies applied by students in the faculties of Arts & Education, Commerce & Law and Social Sciences and those applied by students in the faculty of Physical Sciences. Most research projects in the faculty of Physical Sciences, in the department of Agriculture, were quantitative by nature, guided by relational research questions and hypotheses. These studies used simple experiments to collect numerical data through the use of tests and observations, applied statistical analysis of data and presented data through the use of statistical tables. Almost all studies in the same faculty, in the department of Geography, were case studies and employed mixed methods. Most research studies from the faculties of Arts and Education, Commerce and Law and Social Sciences were qualitative, employed the descriptive survey research design, used questionnaires and interviews and used both quantitative and qualitative techniques to analyse, and present research findings. However, a significant number of projects across faculties did not identify the research paradigm. The present study established a growing trend, amongst qualitative researchers, towards the use of mixed methods. Relational analysis revealed that students’ projects demonstrated a high degree of methodological appropriateness and methodological quality. Appropriate linkages were established between research questions, data collected and the methods used in data collection, analysis and presentation. The use of mixed methods also enhanced the quality and appropriateness of the research methodology. However, The confinement of students’ projects to descriptive surveys and to simple experiments reflected limited knowledge and low- level research skills in both research students and perhaps their supervisors. The relational analysis model employed in the present study was found to be very useful in the quality assessment of students’ research projects. Research students and their supervisors can use this model to assess quality of their own research work. The study recommends that developers of teaching and learning materials should develop courses and materials that adequately equip students with the right knowledge and skills required for research. There is also need to evaluate the current courses that prepare students for research work. These courses are: Ø Introduction To Research Methods Ø Statistics For Educational Research And Ø Computer Application In Educational Research

Keywords

-

References

• Bogdan R. C. & Biklen S. K. (1992) Qualitative Research for Education. Boston Allyn and Bacon.
• Borg, W. R. & Gall, M. D. (1989). Educational Research. White Plains. N Y. Longman.
• Campbell, D. T. & Stanley, J C. (1963). Experimental and Quasi-Experimental Designs for
• Research on Teaching. Chicago, Rand McNally. Campbell, D. T. & Stanley, J. C. (1966). Experimental and Quasi-Experimental Designs for
• Research. Skokie, I L. Rand McNally. Cook, T. D. & Campbell, D. T. (1979). Quasi-Experimentation: Design and analysis issues for field settings. Chicago, Rand McNally.
• Dellana, S., Collins, W. & West, D. (2000). Online education in a management science course-effectiveness and performance factors. Journal of Education for Business, 76,43-48.
• DeSantis, C. (2002). ELearners.com. Retrieved November 2, 2002, http:// elearners. Com
• Dodds, A. E., Lawrence, J. A. & Guiton, P. (1994). University students‘ perceptions of influences on external study. Distance Education, 5(2), 174-185.
• Filstead, W. J. (1970). Qualitative Methodology. Chicago: Markham. Gage, N. L. (1989).
• The paradigm Wars and their Aftermath. Educational Researcher, 18(7), 4-10. Gall, M., Borg, W. & Gall, J. (1996). Educational research: An introduction (6th ed.). New York: Longman.
• Guba, E. G. (1978). Toward a methodology of naturalistic inquiry in educational evaluation. Monograph 8. Los Angeles: UCLA Center for the Study of Evaluation.
• Greene, J., and Caracelli, V. J. (2002). Making paradimatic sense of mixed methods practice. Thousand Oaks, C A: Sage.
• Hedrick, T. E., Bickman, L. & Rog D. (1993). Applied Research design: A practical Guide:
• Newbury Park. C A: Sage. Kangai, C. V. & Mapolisa, T. (2008). Citation analysis of research projects submitted by
• Bachelor of Education (EAPPS) students‘ (2000-2004) to the department of education at the Zimbabwe Open University: Implications for educators and librarians.
• Kember, D. & Dekkers J. (1987). The role of study centres for academic support, Distance Education, 8 (1), 4-17.
• Krathwohl, D. R. (1985). Methods of Educational and Social Science Research. White Plains. N Y. Longmans.
• Lather, P. (1992). Critical frames in Educational Research: Feminist and post structural perspectives: Theory and Practice.
• Lincoln, Y. & Guba, E. (1985). Naturalistic inquiry. New York: Sage. Moon, S., Dillon, D., &
• Sprenkle, D. (1990). Family therapy and qualitative research.
• Lincoln, Y. S. & Guba, E. G. (2000). Paradigmatic controversies, contradictions and emerging confluences. Thousand Oaks C A: Sage.
• Maxcy, S. J. (2003). Pragmatic threads in mixed methods research in the Social Sciences:
• The search for multiple modes of inquiry and the end of philosophy of formalism. Thousand Oaks, C A: Sage. McMillan, J. H. & Schumacher, S. (1993). Research in Education: A Conceptual introduction, 3 th Edition. Happer, Collins College Publishers.
• Mertens, D. M. (2005). Research and Evaluation in Education and Psychology: Integrative diversity with quantitative, qualitative and mixed methods. 2nd Edition London. Sage Publications.
• Miles, M. B. (1983). Qualitative dataas an attracive nuisance: The problem of analysis. In J.
• Van Maanen (Ed.), Qualitative methodology. Beverly Hills, CA: Sage. Myrdal, S. (1994). Teacher education on line: What gets lost in electronic communication;
• Educational measurement: Issues and practice. Nyawaranda, V. A. (2005). Supervising Research Projects/ Dissertations. A Paper delivered at the Zou Workshop in Mashonaland Central Region. Bindura.
• Osman, R. & Wagner G. A. (1987). New Zealand management students‘ perceptions of communicationtechnologies in correspondents education. Distance Education, 8(1), 47-63.
• Owens, R. (1982). Methodological rigor in naturalistic inquiry: Some issues and answers.
• Educational Administration Quarterly, 18(2), 1-21. Patton, M. Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage.
• Patton, M. Q. (2002). Qualitative Evaluation and Research Methods. Thousand Oaks, C.A: California, Sage.
• Perraton, H. (1988). A theory for distance education. In D. sewart, D. Keegan, & B.
• Holmberg (Ed.), Distance education: Interenationalperspective (pp.34-35) New York: Routledge. Phipps, R. & Merisotis, J. (1999). What‘s the Difference? A review of Contemporary
• Research on the Effectiveness of Distance Education in Higher Education. The institute for Higher Education policy. Reckase, M. D. (1995). Portifolio assessment: A theoretical estimate of score reliability.
• Russek, B. E. & Weinberg, S. L. (1993). Mixed methods in a study of implementation of technology-based materials in the elementary classroom. Evaluation and Program Planning, 16 (2), 131-142.
• Russell,, T. L. (1999). The no significant difference phenomenon. Raleigh, NC: North
• Carolina State University. Schwandt, T. (2000). Three epistemological stances for qualitative enquiry:
• Interpretivism, Hermeneutics and Social Constructionism. Beverly Hills, C A: Sage. Smith, R. B. & Manning, p. K. (1982). A Handbook of social science methods, volume 2:
• Qualitative methods. Cambridge, MA: Ballinger. Straus, A. & Corbin, J. (1990). Basics of qualitative research. Newbury Park, CA: Sage.
• Teddlie, C. & Tashakkori, A. (2003). Major issues and controversies in the use of mixed methods in Social and Behavioural Sciences. Thousand Oaks, C A: Sage.