Review
BibTex RIS Cite

Development of a Short Form: Methods, Examinations, and Recommendations

Year 2020, Volume: 11 Issue: 3, 302 - 310, 27.09.2020

Hakan Koğar

https://doi.org/10.21031/epod.739548
Cited By: 8

Abstract

The aim of this review is to explain the methods that can be used when developing short form of a measurement tool and to examine some short form development studies in the field of health sciences literature by taking into consideration the criticisms of short form development studies. It is seen that short form development studies are especially concentrated in the fields of health sciences. The main reason for this situation has been shown that clinicians need fast and reliable measurement tools to reduce the pressure on them. The review results of the 12 articles selected for this research show that there are very few studies that follow the guidelines for short form development. Researchers are advised to develop the short form of the scale by taking into account the criteria mentioned in this study. It is recommended to select measurement instruments which are developed in accordance with ethical rules and have sufficient psychometric properties. Clinical researchers should be aware that the perception that measuring instruments containing less items are less valid does not show the truth. The same psychometric standards are sought for each measurement tools.

Keywords

short form scale development classical test theory item response theory

References

  • Baiocco, R., Pallini, S., & Santamaria, F. (2014). The development and validation of an Italian short form of the adolescent friendship attachment scale. Measurement and Evaluation in Counseling and Development, 47(4), 247-255. https://doi.org/10.1177/0748175614538060
  • Biggers, J.L. (1976). An a priori approach for developing short-forms of tests and inventories. The Journal of Experimental Education, 44(3), 8-10. https://doi.org/10.1080/00220973.1976.11011528
  • Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M Lord, & R. Novick (Eds.), Statistical Theories of Mental Test Scores (pp. 397–479). Reading, MA: MIT Press.
  • Bohlmeijer, E., Ten Klooster, P. M., Fledderus, M., Veehof, M. , & Baer, R. (2011). Psychometric properties of the five facet mindfulness questionnaire in depressed adults and development of a short form. Assessment, 18(3), 308-320. https://doi.org/10.1177/1073191111408231
  • Doll, E. A. (1917). A brief Binet-Simon scale. Psychological Clinic, 11, 197-211.
  • Doppelt, J. E. (1956). Estimating the full scale score on the Wechsler Adult Intelligence Scale from scores on four subjects. Journal of Consulting Psychology, 20(1), 63. https://doi.org/10.1037/h0044293
  • Dorigo, M., & Stützle, T. (2004). Ant colony optimization. Cambridge, MA: MIT Press. https://doi.org/10.7551/mitpress/1290.001.0001
  • Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, NJ: L. Erlbaum Associates.
  • Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
  • Ferrario, S. R., Panzeri, A., Anselmi, P., & Vidotto, G. (2019). Development and psychometric properties of a short form of the Illness Denial Questionnaire. Psychology Research and Behavior Management, 12, 727. https://doi.org/10.2147/PRBM.S207622
  • Jenkinson, C., Kelly, L., Dummett, S., & Morley, D. (2019). The Oxford Participation and Activities Questionnaire (Ox-PAQ): development of a short form and index measure. Patient Related Outcome Measures, 10, 227-232. https://doi.org/10.2147/PROM.S210416
  • Goretzko, D., Pham, T. T. H., & Bühner, M. (2019). Exploratory factor analysis: Current use, methodological developments and recommendations for good practice. Current Psychology, (In Press), 1-12. https://doi.org/10.1007/s12144-019-00300-2
  • Hagtevt, K. A., & Sipos, K. (2016). Creating short forms for construct measures: The role of exchangeable forms. Pedagogika, 66(6), 689-713.
  • Hambleton, R. K., Swaninathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Newbury Park, CA: Sage Publications.
  • Henning, G. (1987). A guide to language testing- development, evaluation, Research. London: Newbury House Publisher.
  • Koğar, H. (2015). Madde tepki kuramına ait parametrelerin ve model uyumlarının karşılaştırılması: Bir Monte Carlo Çalışması. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 6(1), 142-157. https://doi.org/10.21031/epod.02072
  • Lei, P. W., Dunbar, S. B., & Kolen, M. J. (2004). A comparison of parametric and nonparametric approaches to item analysis for multiple choice tests. Educational and Psychological Measurement, 64, 565–587. https://doi.org/10.1177/0013164403261760
  • Leite, W. L., Huang, I. C., & Marcoulides, G. A. (2008). Item selection for the development of short forms of scales using an ant colony optimization algorithm. Multivariate Behavioral Research, 43(3), 411-431. https://doi.org/10.1080/00273170802285743
  • Levy, P. (1968). Short-form tests: A methodological review. Psychological Bulletin, 69(6), 410. https://doi.org/10.1037/h0025736
  • Lim, S. Y., & Chapman, E. (2013). Development of a short form of the attitudes toward mathematics inventory. Educational Studies in Mathematics, 82(1), 145-164. https://doi.org/10.1007/s10649-012-9414-x
  • Meijer, R. R., & Baneke, J. J. (2004). Analyzing psychopathology items: A case seng for nonparametric item response theory modeling. Psychological Methods, 9, 354–368. https://doi.org/10.1037/1082-989X.9.3.354
  • Milavic, B., Padulo, J., Grgantov, Z., Milić, M., Mannarini, S., Manzoni, G. M. ..., & Rossi, A. (2019). Development and factorial validity of the Psychological Skills Inventory for Sports, Youth, version–Short Form: Assessment of the psychometric properties. PloS one, 14(8), 1-17. https://doi.org/10.1371/journal.pone.0220930
  • Mokken, R. J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous responses. Applied Psychological Measurement, 6, 417–430. https://doi.org/10.1177/014662168200600404
  • Morin, D., Valois, P., Crocker, A. G., & Robitaille, C. (2019). Development and psychometric properties of the Attitudes Toward Intellectual Disability Questionnaire–Short Form. Journal of Intellectual Disability Research, 63(6), 539-547. https://doi.org/10.1111/jir.12591
  • Nimon, K., & Zigarmi, D. (2015). Development of the work intention inventory short‐form. New Horizons in Adult Education and Human Resource Development, 27(1), 15-28. https://doi.org/10.1002/nha3.20090
  • Park, H., & Hill, R. B. (2018). Development and validation of a short form of the occupational work ethic inventory. Journal of Career and Technical Education, 32(1), 9-28. https://doi.org/10.21061/jcte.v32i1.1588
  • Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Denmark’s Paedagogiske Institut.
  • Rogers, M. E., Creed, P. A., Searle, J., & Hartung, P. J. (2011). The physician values in practice scale-short form: Development and initial validation. Journal of Career Development, 38(2), 111-127. https://doi.org/10.1177/0894845310363593
  • Sodano, S. M., & Tracey, T. J. (2011). A brief Inventory of Interpersonal Problems–Circumplex using nonparametric item response theory: Introducing the IIP–C–IRT. Journal of Personality Assessment, 93(1), 62-75. https://doi.org/10.1080/00223891.2010.528482
  • Raykov, T., & Marcoulides, G. A. (2011). Classical item analysis using latent variable modeling: a note on a direct evaluation procedure, Structural Equation Modeling, 18(2), 315-324. https://doi.org/10.1080/10705511.2011.557347
  • Siefert, C. J., Sexton, J., Meehan, K., Nelson, S., Haggerty, G., Dauphin, B., & Huprich, S. (2019). Development of a short form for the DSM–5 levels of personality functioning questionnaire. Journal of Personality Assessment, (In Press), 1-11. https://doi.org/10.1080/00223891.2019.1594842
  • Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12(1), 102-111. https://doi.org/10.1037/1040-3590.12.1.102
  • Woudstra, A. J., Meppelink, C. S., Maat, H. P., Oosterha, ven, J., Fransen, M. P., & Dima, A. L. (2019). Validation of the short assessment of health literacy (SAHL-D) and short-form development: Rasch analysis. BMC Medical Research Methodology, 19(1), 122-131. https://doi.org/10.1186/s12874-019-0762-4

Kısa Form Geliştirme: Yöntemler, Öneriler ve İncelemeler

Year 2020, Volume: 11 Issue: 3, 302 - 310, 27.09.2020

Hakan Koğar

https://doi.org/10.21031/epod.739548
Cited By: 8

Abstract

Bu derleme çalışmanın amacı, bir ölçme aracının kısa formu geliştirilirken kullanılabilecek yöntemleri açıklamak ve kısa form geliştirme çalışmalarına getirilen eleştirileri de dikkate alarak özellikle sağlık bilimleri alan yazınında yer alan bazı kısa form geliştirme çalışmalarını yöntemsel olarak incelemektir. Kısa form geliştirme çalışmalarının özellikle sağlık bilimlerine ait alanlarda yoğunlaştığı görülmektedir. Bu durumun temel nedeni olarak klinikte çalışan uzmanların üzerlerindeki baskıyı azaltacak hızlı ve güvenilir ölçme araçlarına ihtiyaç duymaları gösterilmiştir. Bu araştırma için seçilen 12 makalenin inceleme sonuçları göstermektedir ki kısa form geliştirme ile ilgili kurallara uyan çok az araştırma vardır. Bu durum, 20. yüzyılın ortalarından itibaren tartışılan kısa form geliştirme çalışmalarının halen tartışmaya açık olduğunu göstermektedir. Araştırmacılara ölçme aracının uzun formundan hareket ederek, bu çalışmada bahsedilen ölçütleri de dikkate alarak, ölçeğin kısa formunu geliştirmesi önerilmektedir. Etik kurallara uygun bir şekilde geliştirilen ve psikometrik özelliklere yeterli düzeyde sahip olan ölçme araçlarının seçilmesi önerilmektedir. Klinik araştırmacılar bilmelidir ki daha az madde içeren ölçme araçlarının daha az geçerli olduğu şeklindeki bir algı doğruyu göstermemektedir. Her ölçme aracı için aynı psikometrik standartlar aranmaktadır.

Keywords

Kısa form ölçek geliştirme klasik test kuram madde tepki kuramı

References

  • Baiocco, R., Pallini, S., & Santamaria, F. (2014). The development and validation of an Italian short form of the adolescent friendship attachment scale. Measurement and Evaluation in Counseling and Development, 47(4), 247-255. https://doi.org/10.1177/0748175614538060
  • Biggers, J.L. (1976). An a priori approach for developing short-forms of tests and inventories. The Journal of Experimental Education, 44(3), 8-10. https://doi.org/10.1080/00220973.1976.11011528
  • Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M Lord, & R. Novick (Eds.), Statistical Theories of Mental Test Scores (pp. 397–479). Reading, MA: MIT Press.
  • Bohlmeijer, E., Ten Klooster, P. M., Fledderus, M., Veehof, M. , & Baer, R. (2011). Psychometric properties of the five facet mindfulness questionnaire in depressed adults and development of a short form. Assessment, 18(3), 308-320. https://doi.org/10.1177/1073191111408231
  • Doll, E. A. (1917). A brief Binet-Simon scale. Psychological Clinic, 11, 197-211.
  • Doppelt, J. E. (1956). Estimating the full scale score on the Wechsler Adult Intelligence Scale from scores on four subjects. Journal of Consulting Psychology, 20(1), 63. https://doi.org/10.1037/h0044293
  • Dorigo, M., & Stützle, T. (2004). Ant colony optimization. Cambridge, MA: MIT Press. https://doi.org/10.7551/mitpress/1290.001.0001
  • Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, NJ: L. Erlbaum Associates.
  • Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
  • Ferrario, S. R., Panzeri, A., Anselmi, P., & Vidotto, G. (2019). Development and psychometric properties of a short form of the Illness Denial Questionnaire. Psychology Research and Behavior Management, 12, 727. https://doi.org/10.2147/PRBM.S207622
  • Jenkinson, C., Kelly, L., Dummett, S., & Morley, D. (2019). The Oxford Participation and Activities Questionnaire (Ox-PAQ): development of a short form and index measure. Patient Related Outcome Measures, 10, 227-232. https://doi.org/10.2147/PROM.S210416
  • Goretzko, D., Pham, T. T. H., & Bühner, M. (2019). Exploratory factor analysis: Current use, methodological developments and recommendations for good practice. Current Psychology, (In Press), 1-12. https://doi.org/10.1007/s12144-019-00300-2
  • Hagtevt, K. A., & Sipos, K. (2016). Creating short forms for construct measures: The role of exchangeable forms. Pedagogika, 66(6), 689-713.
  • Hambleton, R. K., Swaninathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Newbury Park, CA: Sage Publications.
  • Henning, G. (1987). A guide to language testing- development, evaluation, Research. London: Newbury House Publisher.
  • Koğar, H. (2015). Madde tepki kuramına ait parametrelerin ve model uyumlarının karşılaştırılması: Bir Monte Carlo Çalışması. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 6(1), 142-157. https://doi.org/10.21031/epod.02072
  • Lei, P. W., Dunbar, S. B., & Kolen, M. J. (2004). A comparison of parametric and nonparametric approaches to item analysis for multiple choice tests. Educational and Psychological Measurement, 64, 565–587. https://doi.org/10.1177/0013164403261760
  • Leite, W. L., Huang, I. C., & Marcoulides, G. A. (2008). Item selection for the development of short forms of scales using an ant colony optimization algorithm. Multivariate Behavioral Research, 43(3), 411-431. https://doi.org/10.1080/00273170802285743
  • Levy, P. (1968). Short-form tests: A methodological review. Psychological Bulletin, 69(6), 410. https://doi.org/10.1037/h0025736
  • Lim, S. Y., & Chapman, E. (2013). Development of a short form of the attitudes toward mathematics inventory. Educational Studies in Mathematics, 82(1), 145-164. https://doi.org/10.1007/s10649-012-9414-x
  • Meijer, R. R., & Baneke, J. J. (2004). Analyzing psychopathology items: A case seng for nonparametric item response theory modeling. Psychological Methods, 9, 354–368. https://doi.org/10.1037/1082-989X.9.3.354
  • Milavic, B., Padulo, J., Grgantov, Z., Milić, M., Mannarini, S., Manzoni, G. M. ..., & Rossi, A. (2019). Development and factorial validity of the Psychological Skills Inventory for Sports, Youth, version–Short Form: Assessment of the psychometric properties. PloS one, 14(8), 1-17. https://doi.org/10.1371/journal.pone.0220930
  • Mokken, R. J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous responses. Applied Psychological Measurement, 6, 417–430. https://doi.org/10.1177/014662168200600404
  • Morin, D., Valois, P., Crocker, A. G., & Robitaille, C. (2019). Development and psychometric properties of the Attitudes Toward Intellectual Disability Questionnaire–Short Form. Journal of Intellectual Disability Research, 63(6), 539-547. https://doi.org/10.1111/jir.12591
  • Nimon, K., & Zigarmi, D. (2015). Development of the work intention inventory short‐form. New Horizons in Adult Education and Human Resource Development, 27(1), 15-28. https://doi.org/10.1002/nha3.20090
  • Park, H., & Hill, R. B. (2018). Development and validation of a short form of the occupational work ethic inventory. Journal of Career and Technical Education, 32(1), 9-28. https://doi.org/10.21061/jcte.v32i1.1588
  • Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Denmark’s Paedagogiske Institut.
  • Rogers, M. E., Creed, P. A., Searle, J., & Hartung, P. J. (2011). The physician values in practice scale-short form: Development and initial validation. Journal of Career Development, 38(2), 111-127. https://doi.org/10.1177/0894845310363593
  • Sodano, S. M., & Tracey, T. J. (2011). A brief Inventory of Interpersonal Problems–Circumplex using nonparametric item response theory: Introducing the IIP–C–IRT. Journal of Personality Assessment, 93(1), 62-75. https://doi.org/10.1080/00223891.2010.528482
  • Raykov, T., & Marcoulides, G. A. (2011). Classical item analysis using latent variable modeling: a note on a direct evaluation procedure, Structural Equation Modeling, 18(2), 315-324. https://doi.org/10.1080/10705511.2011.557347
  • Siefert, C. J., Sexton, J., Meehan, K., Nelson, S., Haggerty, G., Dauphin, B., & Huprich, S. (2019). Development of a short form for the DSM–5 levels of personality functioning questionnaire. Journal of Personality Assessment, (In Press), 1-11. https://doi.org/10.1080/00223891.2019.1594842
  • Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12(1), 102-111. https://doi.org/10.1037/1040-3590.12.1.102
  • Woudstra, A. J., Meppelink, C. S., Maat, H. P., Oosterha, ven, J., Fransen, M. P., & Dima, A. L. (2019). Validation of the short assessment of health literacy (SAHL-D) and short-form development: Rasch analysis. BMC Medical Research Methodology, 19(1), 122-131. https://doi.org/10.1186/s12874-019-0762-4
There are 33 citations in total.

Details

Primary Language English
Journal Section Articles
Authors

Hakan Koğar 0000-0001-5749-9824

Publication Date September 27, 2020
Acceptance Date September 8, 2020
Published in Issue Year 2020 Volume: 11 Issue: 3

Cite

APA Koğar, H. (2020). Development of a Short Form: Methods, Examinations, and Recommendations. Journal of Measurement and Evaluation in Education and Psychology, 11(3), 302-310. https://doi.org/10.21031/epod.739548

Cited By

Versión breve del Cuestionario Revisado de Proceso de Estudio-2 Factores: Un análisis psicométrico en estudiantes universitarios
European Journal of Education and Psychology
https://doi.org/10.32457/ejep.v14i2.1656
Psychometric Features of the Academic Resilience Scale-Short Version (ARS-SV): A Bifactor Exploratory Structural Equation Modeling Study
Adversity and Resilience Science
https://doi.org/10.1007/s42844-024-00150-3
Kişilerarası Bağımlılık Ölçeği’nin Kısa Formunun Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması
Muş Alparslan Üniversitesi Eğitim Fakültesi Dergisi
https://doi.org/10.60107/maunef.1487611
Personal recovery self-report outcome measures in serious mental illness: A systematic review of measurement properties
Clinical Psychology Review
https://doi.org/10.1016/j.cpr.2024.102459
Adaptation of the Turkish Family of Origin Scale and the Development of Parallel Short Forms
International Journal of Systemic Therapy
https://doi.org/10.1080/2692398X.2024.2331856
Development of the Animal Empathy Scale Short Form
Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry
https://doi.org/10.18863/pgy.1282134
Psychometric Evaluation of the Adaptation of the Short Form Foreign Language Classroom Anxiety Scale
Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi
https://doi.org/10.17240/aibuefd.2023..-1138588
Smartphone stress: Concept, structure, and development of measurement among adolescents
Cyberpsychology: Journal of Psychosocial Research on Cyberspace
https://doi.org/10.5817/CP2022-5-1
 Download Cover Image