Does Statistical Power Affect a Study’s Results? How Many Sample Size?

Year 2020, Cumhuriyet Armağan Sayısı, 157 - 174, 28.10.2020

Burak Keskin

https://doi.org/10.18026/cbayarsos.644692

Cited By: 11

Abstract

The statistical power analysis is a method that enables to plan a highly valid and reliable research and to guarantee the validity, reliability and sensibility of the results of a research. Statistical power is an approach which is used to evaluate to what degree the decisions obtained as a result of statistical tests used to test an aim are valid and reliable in terms of probability values. Various statistical analyses begin the analysis with the existing data and focus on the comments of the consequences. Nevertheless, power analysis is meaningful before data collection and significant in the process of setting the hypothesis. In this context, the major purposes of this study are; to contribute researches in social sciences by creating awareness about what the power analysis means and to guide researchers about how the power analyses can be employed in a social science study.

İstatistiksel Güç Bir Araştırmanın Sonuçlarına Etki Eder Mi? Örneklem Büyüklüğüne Nasıl Karar Verilmeli?

Abstract

İstatistiksel güç analizi; güvenilirliği, geçerliliği yüksek bir araştırma planlamayı ve araştırma sonucunda alınacak kararların geçerliliğini, güvenilirliğini ve duyarlılığını garanti altına almayı sağlayan bir yöntemdir. İstatistiksel güç, araştırmada bir hipotezin denetlenmesi için kullanılan istatistiksel testler sonucunda varılan kararın ne kadar güvenilir ve geçerli olduğunu olasılık olarak tahmin eden bir yaklaşımdır. Güç analizi, diğer istatistiksel yaklaşımlardan önemli ölçüde farklıdır. Birçok istatistiksel analiz mevcut veri ile analize başlamakta ve sonuçların yorumuna odaklanmaktadır. Hâlbuki güç analizi daha çok veri toplama öncesinde anlamlıdır ve hipotez kurma sürecinde önemlidir. Bu bağlamda çalışmanın amacı, sosyal bilim çalışmalarında istatistiksel güç analizinin ne olduğu konusunda farkındalık oluşturarak araştırmalara katkı sağlamak ve bir araştırmada istatistiksel güç analizinin nasıl kullanılacağı konusunda araştırmacılara rehberlik etmektir.

Keywords

İstatistiksel Güç, İstatistiksel Güç Analizi, Etki Büyüklüğü

References

• Aberson, C. L. (2010). Applied Power Analysis for the Behavioral Sciences. New York: Routledge. Abraham, W. T. ve Russell, D. W. (2008). “Statistical Power Analysis in Psychological Research”. Social and Personality Psychology Compass 2(1): 283–301. AERA (2006). “Standards for Reporting on Empirical Social Science Research in AERA Publications”. American Educational Research Association, Educational Researcher 35(6): 33–40. APA (2001). “Publication Manual of the American Psychological Association, 5th Edition”, Washington, DC: American Psychological Association. Balkin, R. S. ve Sheperis, K. J. (2011). “Evaluating and Reporting Statistical Power in Counseling Research”. Journal of Counseling and Development: JCD; Summer 2011 89: 268-272. Borkowski, S. C., Welsh, M. J. ve Zhang, Q., (2001). “An Analysis of Statistical Power in Behavioral Accounting Research”. Behavioral Research in Accounting 13: 63-84. Cafri, G., Kromrey, J. D. ve Brannick, M. T. (2009). “A Sas Macro for Statistical Power Analysis in Meta-Analysis”. Behavior Research Methods 41(1): 35-46. Cashen, L. H. ve Geiger S. W. (2004). “Statistical Power and the Testing of Null Hypothesis: A Review of Contemporary Management Research and Recommendations for Future Studies”. Organizational Research Methods 7(2): 151-167. Clark, D. (1996). Statistical Power as a Contributing Factor Affecting Significance Among Dissertations in the School of Religious Education at Southwestern Baptist Theological Seminary. Doctoral Dissertation, USA. Chase, L. J. ve Chase, R. B. (1976). “A Statistical Power Analysis of Applied Psychological Research”. Journal of Applied Psycology 61(2): 234-237. Coblick, G. E. (1998). Statistical Power Analysis in Nursing Research. Doctoral Dissertation, Auburn University, Alabama, USA. Cohen, J. (1962). “The statistical power of abnormal-social psychological research: A review”. Journal of Abnormal and Social Psychology 65: 145–153. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.), Hillsdale, NJ: Lawrence Erlbaum.Cohen, J. (1992. “A power primer”. Psychological Bulletin 112(1): 155–159. Dilullo, L. K. (1997). A Post Hoc Power Analysis of Inferential Research Examining The Relationship Between Mathematic Anxiety and Mathematic Performance. Doctoral Dissertation, Auburn University, Alabama, USA. Ellis, P. D. (2010). The Essential Guide to Effect Size, Statistical Power, Meta-Analysis and Interpretation Research Results. Cambridge University Press. Ertürk, M. Ş. (2005). “Retrospective Power Analysis: When?”. Radiology 237(2): 743-744. Fagley, N. S. (1985). “Applied Statistical Power Analysis and the Interpretation of Nonsignificant Results by Research Comsumers”. Journal of Counseling Psychology 32(3): 391-396.Flynn, K., Swintek, J. & Johnson, R. (2017). “The Influence of Control Group Reproduction on the Statistical Power of the Environmental Protection Agency's Medaka Extended One Generation Reproduction Test (MEOGRT)”. Ecotoxicology and Environmental Safety, 136: 8-13. Erdfelder, E., Faul, F. ve Buchner, A. (1996). “GPower: A General Power Analysis Program”. Behavior Research Methods, Instruments & Computers 28(1): 1-11. Hoenig, J. ve Heisey, D. W. (2001). “The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis”. The American Statistician 55(1): 1-6. Jones, A. ve Sommerlund, B. (2007). “A Critical Discussion of Null Hypothesis Significance Testing and Statistical Power Analysis within Psychological Research”. Nordic Psychology 59(3): 223-230. Kosciulek, J. F. ve Szymanski, E. M. (1993). “Statistical Power Analysis of Rehabilitation Counseling Research”. Rehabilitation Counseling Bulletin 36(4): 212-219. Lewis, K. P. (2006). “Statistical Power, Sample Sizes and the Software to Calculate Them Easily”. Bioscience 56(7): 607-612. Maccallum, R. C., Browne, M. ve Sugawara, H. M. (1996). “Power Analysis and Determination of Sample Size for Covariance Structure Modeling”. Psychological Methods 1(2): 130-149. Mazen, A. M., Graf, L., A., Kellog, K. E. ve Hemmasi, M. (1987). “Statistical Power in Contemporary Management Research”. The Academy of Management Journal 30(2): 369-380. McKean, K. E. (1990). Statistical Power Analysis of Doctoral Dissertation Research in Educational Psychology. Doctoral Dissertation, Oklahoma State University, Oklahoma, USA. O’Keefe, D. J. (2007). “Post Hoc Power, Observed Power, A Priori Power, Retrospective Power, Prospective Power, Achieved Power: Sorting Out Appropriate Uses of Statistical Power Analyses”. Communication Methods and Measures, Lawrence Erlbaum Associates, Inc, I(4): 291-299. Olejnik, S. F. (1984). “Planning Educational Research: Determinig to Necessary Sample Size”. Journal of Experimental Education 53(1): 40-48. Onwuegbuzie, A. J. ve Leech, N. L. (2004). “Post Hoc Power: A Concept Whose Time Has Come”. Understanding Statistics 3(4): 201-230. Rose, R. A. ve Bowen, G. L. (2009). “Power Analysis in Intervention Research: Designing Cluster-Randomized Trials”. Social Work Research 33(1): 43-52. Rossi, J. S. (2012, in Press). Statistical Power Analysis. In J. A. Schinka & W. F. Welicer(Eds.), Handbook of Psychology. Volume 2: Research Methods in Psychology (2nd. Ed.). John Wiley & Sons. Rotenberry, J. T. ve Wiens, J. A. (1985). “Statistical Power Analysis and Community-Wide Patterns”. 125(1): 164-168. Sacco, W. (1982). “Statistical Power Considerations in the Use of Cost-Effectiveness Analysis”. Professional Psychology 13(5): 752, 758. Sawyer, A. G. ve Ball, D. A. (1981). “Statistical Power and Effect Size in Marketing Research”. Journal of Marketing Research XVIII: 275-290. Tener, Mark, A. (2000). A Post Hoc Statistical Power Analysis a Survey of the Research Published in the Journal of Athletic Training. Doctoral Dissertation, Middle Tennessee State University, Tennessee, USA. Thalheimer, W. ve Cook, S. (2002). “How to Calculate Effect Sizes From Published Research Articles: A Simplified Methodology”, http://education.gsu.edu/coshima/EPRS8530/Effect_Sizes_pdf4.pdf, Erişim Tarihi: 15.05.12. Thomas, L. ve Juanes, F. (1996). “The İmportance of Statistical Power Analysis: An Example from Animal Behaviour”. Animal Behaviour 52: 856-859.