Interview with Stephen G. SIRECI on Validity

Year 2017, Volume: 8 Issue: 1, 158 - 168, 31.03.2017

Nuri Doğan

Abstract

The following questions were created within the scope of
Classical Test Theory course (OLC720) offered in the doctoral programme of
Measurement and Evaluation in Education branch in the Educational Sciences
Department of Hacettepe University. The question of “what three questions about
validity would you ask if an internationally famous expert was in front of
you?” was asked 23 students taking the course, and the participants were asked
to write down their questions. 69 questions in total were revised by the
lecturer of the course in terms of scope, importance and clarity, and the
number of questions was reduced to 37 by removing 32 of them. The students
participating in the classes were then asked to order the questions selected by
the lecture from the most important to the least important. The order of
importance for each question was determined by adding up the scores given by
the students. 15 out of the 37 questions which had been ordered according to
the students’ rating were selected to be answered.

Keywords

Validity, Interview

References

• APA. (1952). Committee on Test Standards. Technical recommendations for psychological tests and diagnostic techniques: preliminary proposal. American Psychological Association Washington DC US. [American Psychologist, 7(8), 461-475. http://dx.doi.org/10.1037/h0056631 ]
• APA. (1954). Technical recommendations for psychological tests and diagnostic techniques. American Psychological Association Washington DC US. [Psychological bulletin, 51, 2, pt. 2, March 1954. Supplement.]
• APA. (1966). Standards for educational and psychological tests and manuals. American Psychological Association Washington DC US. [Educational and Psychological Measurement, 26, 3, 751-767 October 1, 1966 DOI: https://doi.org/10.1177/001316446602600328]
• APA, AERA, & NCME (1974). Standardsfor eductiond andpsychological tests and manuals. Washington, DC: American Psychological Association.
• AERA, APA & NCME. (1985). Standards for education and psychological testing. Washington, DC: American Psychological Association.
• AERA, APA, & NCME. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
• AERA, APA, & NCME. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association
• Campbell DT, Fiske DW. (1959). Convergent and discriminant validation by the multitrait multimethod matrix. Psychological. Bulletin. 56,2,81−105.
• Kane, M T. (1992). An argument-based approach to validity. Psychological Bulletin, 112, 3, 527-535. http://dx.doi.org/10.1037/0033-2909.112.3.527
• Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17– 64). Westport: American Council on Education/Praeger.
• Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1–73.
• Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749
• Sireci, S.G. (2012). De-“Constructing” Test Validation. Center for Educational Assessment Research Report No. 814. Amherst, MA: Center for Educational Assessment, University of Massachusetts Amherst.