Development of a Short Form: Methods, Examinations, and Recommendations

Abstract

The aim of this review is to explain the methods that can be used when developing short form of a measurement tool and to examine some short form development studies in the field of health sciences literature by taking into consideration the criticisms of short form development studies. It is seen that short form development studies are especially concentrated in the fields of health sciences. The main reason for this situation has been shown that clinicians need fast and reliable measurement tools to reduce the pressure on them. The review results of the 12 articles selected for this research show that there are very few studies that follow the guidelines for short form development. Researchers are advised to develop the short form of the scale by taking into account the criteria mentioned in this study. It is recommended to select measurement instruments which are developed in accordance with ethical rules and have sufficient psychometric properties. Clinical researchers should be aware that the perception that measuring instruments containing less items are less valid does not show the truth. The same psychometric standards are sought for each measurement tools.

Keywords

• short form
• scale development
• classical test theory
• item response theory

Kısa Form Geliştirme: Yöntemler, Öneriler ve İncelemeler

Abstract

Bu derleme çalışmanın amacı, bir ölçme aracının kısa formu geliştirilirken kullanılabilecek yöntemleri açıklamak ve kısa form geliştirme çalışmalarına getirilen eleştirileri de dikkate alarak özellikle sağlık bilimleri alan yazınında yer alan bazı kısa form geliştirme çalışmalarını yöntemsel olarak incelemektir. Kısa form geliştirme çalışmalarının özellikle sağlık bilimlerine ait alanlarda yoğunlaştığı görülmektedir. Bu durumun temel nedeni olarak klinikte çalışan uzmanların üzerlerindeki baskıyı azaltacak hızlı ve güvenilir ölçme araçlarına ihtiyaç duymaları gösterilmiştir. Bu araştırma için seçilen 12 makalenin inceleme sonuçları göstermektedir ki kısa form geliştirme ile ilgili kurallara uyan çok az araştırma vardır. Bu durum, 20. yüzyılın ortalarından itibaren tartışılan kısa form geliştirme çalışmalarının halen tartışmaya açık olduğunu göstermektedir. Araştırmacılara ölçme aracının uzun formundan hareket ederek, bu çalışmada bahsedilen ölçütleri de dikkate alarak, ölçeğin kısa formunu geliştirmesi önerilmektedir. Etik kurallara uygun bir şekilde geliştirilen ve psikometrik özelliklere yeterli düzeyde sahip olan ölçme araçlarının seçilmesi önerilmektedir. Klinik araştırmacılar bilmelidir ki daha az madde içeren ölçme araçlarının daha az geçerli olduğu şeklindeki bir algı doğruyu göstermemektedir. Her ölçme aracı için aynı psikometrik standartlar aranmaktadır.

Keywords

• Kısa form
• ölçek geliştirme
• klasik test kuram
• madde tepki kuramı

References

1. Baiocco, R., Pallini, S., & Santamaria, F. (2014). The development and validation of an Italian short form of the adolescent friendship attachment scale. Measurement and Evaluation in Counseling and Development, 47(4), 247-255. https://doi.org/10.1177/0748175614538060
2. Biggers, J.L. (1976). An a priori approach for developing short-forms of tests and inventories. The Journal of Experimental Education, 44(3), 8-10. https://doi.org/10.1080/00220973.1976.11011528
3. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M Lord, & R. Novick (Eds.), Statistical Theories of Mental Test Scores (pp. 397–479). Reading, MA: MIT Press.
4. Bohlmeijer, E., Ten Klooster, P. M., Fledderus, M., Veehof, M. , & Baer, R. (2011). Psychometric properties of the five facet mindfulness questionnaire in depressed adults and development of a short form. Assessment, 18(3), 308-320. https://doi.org/10.1177/1073191111408231
5. Doll, E. A. (1917). A brief Binet-Simon scale. Psychological Clinic, 11, 197-211.
6. Doppelt, J. E. (1956). Estimating the full scale score on the Wechsler Adult Intelligence Scale from scores on four subjects. Journal of Consulting Psychology, 20(1), 63. https://doi.org/10.1037/h0044293
7. Dorigo, M., & Stützle, T. (2004). Ant colony optimization. Cambridge, MA: MIT Press. https://doi.org/10.7551/mitpress/1290.001.0001
8. Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, NJ: L. Erlbaum Associates.

9. Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
10. Ferrario, S. R., Panzeri, A., Anselmi, P., & Vidotto, G. (2019). Development and psychometric properties of a short form of the Illness Denial Questionnaire. Psychology Research and Behavior Management, 12, 727. https://doi.org/10.2147/PRBM.S207622
11. Jenkinson, C., Kelly, L., Dummett, S., & Morley, D. (2019). The Oxford Participation and Activities Questionnaire (Ox-PAQ): development of a short form and index measure. Patient Related Outcome Measures, 10, 227-232. https://doi.org/10.2147/PROM.S210416
12. Goretzko, D., Pham, T. T. H., & Bühner, M. (2019). Exploratory factor analysis: Current use, methodological developments and recommendations for good practice. Current Psychology, (In Press), 1-12. https://doi.org/10.1007/s12144-019-00300-2
13. Hagtevt, K. A., & Sipos, K. (2016). Creating short forms for construct measures: The role of exchangeable forms. Pedagogika, 66(6), 689-713.
14. Hambleton, R. K., Swaninathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Newbury Park, CA: Sage Publications.
15. Henning, G. (1987). A guide to language testing- development, evaluation, Research. London: Newbury House Publisher.
16. Koğar, H. (2015). Madde tepki kuramına ait parametrelerin ve model uyumlarının karşılaştırılması: Bir Monte Carlo Çalışması. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 6(1), 142-157. https://doi.org/10.21031/epod.02072
17. Lei, P. W., Dunbar, S. B., & Kolen, M. J. (2004). A comparison of parametric and nonparametric approaches to item analysis for multiple choice tests. Educational and Psychological Measurement, 64, 565–587. https://doi.org/10.1177/0013164403261760
18. Leite, W. L., Huang, I. C., & Marcoulides, G. A. (2008). Item selection for the development of short forms of scales using an ant colony optimization algorithm. Multivariate Behavioral Research, 43(3), 411-431. https://doi.org/10.1080/00273170802285743
19. Levy, P. (1968). Short-form tests: A methodological review. Psychological Bulletin, 69(6), 410. https://doi.org/10.1037/h0025736
20. Lim, S. Y., & Chapman, E. (2013). Development of a short form of the attitudes toward mathematics inventory. Educational Studies in Mathematics, 82(1), 145-164. https://doi.org/10.1007/s10649-012-9414-x
21. Meijer, R. R., & Baneke, J. J. (2004). Analyzing psychopathology items: A case seng for nonparametric item response theory modeling. Psychological Methods, 9, 354–368. https://doi.org/10.1037/1082-989X.9.3.354
22. Milavic, B., Padulo, J., Grgantov, Z., Milić, M., Mannarini, S., Manzoni, G. M. ..., & Rossi, A. (2019). Development and factorial validity of the Psychological Skills Inventory for Sports, Youth, version–Short Form: Assessment of the psychometric properties. PloS one, 14(8), 1-17. https://doi.org/10.1371/journal.pone.0220930
23. Mokken, R. J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous responses. Applied Psychological Measurement, 6, 417–430. https://doi.org/10.1177/014662168200600404
24. Morin, D., Valois, P., Crocker, A. G., & Robitaille, C. (2019). Development and psychometric properties of the Attitudes Toward Intellectual Disability Questionnaire–Short Form. Journal of Intellectual Disability Research, 63(6), 539-547. https://doi.org/10.1111/jir.12591
25. Nimon, K., & Zigarmi, D. (2015). Development of the work intention inventory short‐form. New Horizons in Adult Education and Human Resource Development, 27(1), 15-28. https://doi.org/10.1002/nha3.20090
26. Park, H., & Hill, R. B. (2018). Development and validation of a short form of the occupational work ethic inventory. Journal of Career and Technical Education, 32(1), 9-28. https://doi.org/10.21061/jcte.v32i1.1588
27. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Denmark’s Paedagogiske Institut.
28. Rogers, M. E., Creed, P. A., Searle, J., & Hartung, P. J. (2011). The physician values in practice scale-short form: Development and initial validation. Journal of Career Development, 38(2), 111-127. https://doi.org/10.1177/0894845310363593
29. Sodano, S. M., & Tracey, T. J. (2011). A brief Inventory of Interpersonal Problems–Circumplex using nonparametric item response theory: Introducing the IIP–C–IRT. Journal of Personality Assessment, 93(1), 62-75. https://doi.org/10.1080/00223891.2010.528482
30. Raykov, T., & Marcoulides, G. A. (2011). Classical item analysis using latent variable modeling: a note on a direct evaluation procedure, Structural Equation Modeling, 18(2), 315-324. https://doi.org/10.1080/10705511.2011.557347
31. Siefert, C. J., Sexton, J., Meehan, K., Nelson, S., Haggerty, G., Dauphin, B., & Huprich, S. (2019). Development of a short form for the DSM–5 levels of personality functioning questionnaire. Journal of Personality Assessment, (In Press), 1-11. https://doi.org/10.1080/00223891.2019.1594842
32. Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12(1), 102-111. https://doi.org/10.1037/1040-3590.12.1.102
33. Woudstra, A. J., Meppelink, C. S., Maat, H. P., Oosterha, ven, J., Fransen, M. P., & Dima, A. L. (2019). Validation of the short assessment of health literacy (SAHL-D) and short-form development: Rasch analysis. BMC Medical Research Methodology, 19(1), 122-131. https://doi.org/10.1186/s12874-019-0762-4