Interview with Stephen G. SIRECI on Validity

Abstract

The following questions were created within the scope of Classical Test Theory course (OLC720) offered in the doctoral programme of Measurement and Evaluation in Education branch in the Educational Sciences Department of Hacettepe University. The question of “what three questions about validity would you ask if an internationally famous expert was in front of you?” was asked 23 students taking the course, and the participants were asked to write down their questions. 69 questions in total were revised by the lecturer of the course in terms of scope, importance and clarity, and the number of questions was reduced to 37 by removing 32 of them. The students participating in the classes were then asked to order the questions selected by the lecture from the most important to the least important. The order of importance for each question was determined by adding up the scores given by the students. 15 out of the 37 questions which had been ordered according to the students’ rating were selected to be answered.

Keywords

• Validity,Interview

References

1. APA. (1952). Committee on Test Standards. Technical recommendations for psychological tests and diagnostic techniques: preliminary proposal. American Psychological Association Washington DC US. [American Psychologist, 7(8), 461-475. http://dx.doi.org/10.1037/h0056631 ]
2. APA. (1954). Technical recommendations for psychological tests and diagnostic techniques. American Psychological Association Washington DC US. [Psychological bulletin, 51, 2, pt. 2, March 1954. Supplement.]
3. APA. (1966). Standards for educational and psychological tests and manuals. American Psychological Association Washington DC US. [Educational and Psychological Measurement, 26, 3, 751-767 October 1, 1966 DOI: https://doi.org/10.1177/001316446602600328]
4. APA, AERA, & NCME (1974). Standardsfor eductiond andpsychological tests and manuals. Washington, DC: American Psychological Association.
5. AERA, APA & NCME. (1985). Standards for education and psychological testing. Washington, DC: American Psychological Association.
6. AERA, APA, & NCME. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
7. AERA, APA, & NCME. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association
8. Campbell DT, Fiske DW. (1959). Convergent and discriminant validation by the multitrait multimethod matrix. Psychological. Bulletin. 56,2,81−105.

9. Kane, M T. (1992). An argument-based approach to validity. Psychological Bulletin, 112, 3, 527-535. http://dx.doi.org/10.1037/0033-2909.112.3.527
10. Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17– 64). Westport: American Council on Education/Praeger.
11. Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1–73.
12. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749
13. Sireci, S.G. (2012). De-“Constructing” Test Validation. Center for Educational Assessment Research Report No. 814. Amherst, MA: Center for Educational Assessment, University of Massachusetts Amherst.