TAILORING DATA COLLECTION METHODS TO HARD-TOEXAMINE POPULATIONS: THE USE OF LIFE EVENTS AS RECALL AIDS IN SURVEY RESEARCH

Abstract

Collecting retrospective survey data is known to be error prone and gets even more challenging when it has to be done among populations, like elderly or refugees, for whom recalling life histories entails a difficult task. Concerns about this problem have led to aided recall instruments among which the calendar method is the most encompassing one. This paper examines a central characteristic the calendar method: the use of landmark life events that aim to facilitate recall. Using data from the Event History Calendar as embedded in the PSID-survey (USA) in 1998, we explore what types of landmarks respondents generated and whether the use of landmarks is related to recall accuracy

Keywords

• retrospective surveys, data collection, life events, recall accuracy

References

1. Becker, S., & Diop-Sidibe, N. (2003). Does Use of the Calendar in Surveys Reduce Heaping?
2. Studies in Family Planning, 34(2), 127-132. Belli, R. F. (1998). The structure of autobiographical memory and the Event History Calendar:
3. Potential improvements in the quality of retrospective reports in surveys. Memory, 6 (4), 383-406. Belli, R. F., Lee, E. H., Stafford, F., & Chou, C.-H. (2004). Calendar and question-list survey methods: Association between interviewer behaviors and data quality. Journal of Official Statistics, 20(1), 185-218.
4. Belli, R. F., Shay, W., & Stafford, F. (2001). Event History Calendars and question list surveys: A direct comparison of interviewing methods. Public Opinion Quarterly, 65, 45-74.
5. Belli, R. F., Stafford, R. P., & Alwin, D. F. (2009). Calendar and time diary methods in life course research. Thousand Oaks: Sage
6. Belli, Robert F., Ipek Bilgen and Tarah A. Baghal (2013). Memory, Communication and Data
7. Quality in Calendar Interviews, Public Opinion Quarterly, vol. 77 (special issue), pp. 194-219. Brown, N.R. (2005). On the Prevalence of Event Clusters in Autobiographical Memory. Social Cognition, 23 (1), 35-69.
8. Brown, N.R., & Schopflocher, D. (1998). Event Cueing, Event Clusters, and the Temporal

9. Distribution of Autobiographical Memories. Applied Cognitive Psychology, 12, 305-319. Burt, C. D. B., Kemp, S., & Conway, M. A. (2003). Themes, events, and episodes in autobiographical memory. Memory & Cognition, 32, 317-325.
10. Conway, M. A., & Pleydell-Pearce, C. W. (2000). The construction of Autobiographical memories in the self-memory system. Psychological Review, 107, 261-288.
11. Freedman, D., Thornton, A., Camburn, D., Alwin, D., & YoungDeMarcco, L. (1988). The life history calendar: A technique for collecting retrospective data. Sociological Methodology, 18, 37
12. Friedman, W. J. (1993). Memory for the time of past events. Psychological Bulletin, 113, 44-66.
13. Glasner, T.J., &. Van der Vaart, W. (2009). Applications of Calendar Instruments in Social
14. Surveys. A Review. Quality and Quantity. 43, 333–49. Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1, 77-89.
15. Holmes, A., & Conway, M.A. (1999). Generation Identity and the Reminiscence Bump: Memory for Public and Private Events. Journal of Adult Development, 6 (1), 21-34.
16. Howes, J.L., & Katz, A.N. (1992). Remote Memory: Recalling Autobiographical and Public
17. Events from across the Lifespan. Canadian Journal of Psychology, 46 (1), 92-116. James, L. E., & Burke, D. M. (2000). Phonological priming effects on word retrieval and tip-of- the-tongue experiences in young and older adults. Journal of Experimental Psychology: Learning,
18. Memory, and Cognition, 26(6), 1378-1391.
19. Janssen, S., Chessa, A. & Murre, J. (2006). Memory for time: How people date events. Memory & Cognition, 34, 138–47.
20. Jobe, J.B. and Mingay, D.J. (1989). Cognitive Research Improves Questionnaires. American
21. Journal of Public Health, 79, 1053-1055.
22. Krippendorff, K. (2004). Content analysis: An introduction to its methodology. Thousand Oaks, CA: Sage.
23. Loftus, E. F., & Marburger, W. (1983). Since the eruption of Mt. St. Helens, did anyone beat you up? Improving the accuracy of retrospective reports with landmark events. Memory & Cognition, , 114-120.
24. Quetulio-Navarra, M., Niehof, A., Van der Horst, H.M., & Van der Vaart, W. (2014). Short-term
25. Risk Experience of Involuntary Resettled Households in the Philippines and Indonesia. Habitat International, 41 (1), 165-175. Quetulio-Navarra, M., Van der Vaart, W. & Niehof, A. (2012). “Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations.” In Proceedings of the Eight
26. International Conference on Survey Methodology (cd). Sydney, Australia: ISA-RC33. Rubin, D.C., Rahhal, T.A., & Poon, L.W. (1998). Things Learned in Early Adulthood are
27. Remembered Best. Memory & Cognition, 26 (1), 3-19. Shum, M.S. (1998). The Role of Temporal Landmarks in Autobiographical Memory Processes.
28. Psychological Bulletin, 124 (3), 423-442. Tourangeau, R., Rips, L.J., and Rasinski, K. (2000). The Psychology of Survey Response.
29. Cambridge: Cambridge University Press. Van der Vaart, W. (2004). The time-line as a device to enhance recall in standardized research interviews: A split ballot study. Journal of Official Statistics, 20(2), 301-317.
30. Van der Vaart, W. & Glasner, T.J. (2011). Personal landmarks as recall aids in survey interviews. Field Methods, 23 (1), 37-56.
31. Van der Vaart, W., & Glasner, T.J. (2007). Applying a Timeline as a Recall Aid in a Telephone
32. Survey: A Record Check Study. Applied Cognitive Psychology, 21 (2), 217-238.