Self-Report Methods for Assessing Emotions: Understanding Structure and Accuracy of Measurement

Abstract

Emotion is structurally multifaceted with different components. One of these components, subjective experience, is pivotal in defining and measuring emotions. Self-report methods are used to ascertain the subjective experience of emotion. Unlike the neural and behavioral components of emotion, the qualities in subjective experience have been analyzed relatively less. However, for a more accurate and valid determination, the relevant structure should be well conceptualized. In this sense, the first part of this review precisely refers to the concept of emotional experience. This section concerns the distinctive meaning of subjective experience and details the correlation of subjective experience with other components of emotion. Next, the methods of accessing and expressing this experience will be discussed. Finally, the various scales in literature for measuring subjective experience are discussed. The status of these scales in Turkish and international literature is summarized. After conceptualizing subjective experience, the second part includes crucial aspects that may be useful for a more accurate and valid measurement. For this purpose, temporal issues that are important in measurement are addressed. First, the results of the temporal position of measurement, which may be in the past, future, or online; the results of the differences in the temporal emphasis in the instruction and the mechanism by which it affects the determination are mentioned. Subsequently, systematic explanations of individual differences in the experience of emotion are emphasized. Emotional granularity, referring to the extent to which an emotion is expressed in detail, and emotional dialecticism, indicating the state of experiencing different emotions together, are explained. Individual differences and their potential contribution to measuring and understanding emotion were addressed. The different views on the subjective experience of emotion, the temporal aspects, individual differences that can matter for measurement, and the mechanisms by which they can contribute to determination practices were discussed.

Keywords

• Measuring emotion
• self-report
• subjective experience of emotion
• emotional experience
• phenomenology of emotion.

Duygu Ölçmede Kullanılan Öz Bildirim Yöntemleri: Neyi Ölçer? Nasıl Doğru Ölçer?

Abstract

Duygu farklı bileşenleri olan, çok yönlü bir yapıya sahiptir. Bu bileşenlerden biri olan öznel deneyim hem duygunun tanımında hem de ölçülmesinde önemli bir yer tutmaktadır. Duygunun öznel deneyiminin ölçümünde ise öz bildirim yöntemleri kullanılmaktadır. Fakat literatüre bakıldığında duygunun nöral ve davranışsal bileşenlerinin aksine öznel deneyimindeki niteliklerin görece daha az incelendiği görülmektedir. Oysa ölçümün daha doğru ve geçerli yapılabilmesi için ilgili yapının önce iyi kavramsallaştırılmış olması gerekmektedir. Bu anlamda derlemenin birinci kısmı duygu deneyiminin içeriğinin tam olarak neye tekabül ettiğine ilişkindir. Bu kısımda ilk olarak öznel deneyimin diğer duygu bileşenleriyle olan ilişkileri ve tek başına öznel deneyimin ne ifade ettiği detaylandırılmıştır. Sonrasında ise deneyime erişimin ve bu deneyimin ifadesinin nasıl mümkün olduğundan bahsedilmiştir. Son olarak öznel deneyimin ölçümünü için geliştirilmiş olan literatürde yaygın şekilde kullanılan farklı ölçekler üzerinde durulmuştur. Hem ulusal hem uluslararası literatürdeki ölçeklerin güncel durumları özetlenmiştir. Öznel deneyimin kavramsallaştırılmasının ardından ikinci kısım, daha doğru ve geçerli bir ölçüm için fayda sağlayabilecek önemli hususları içermektedir. Bu amaçla derlemenin ikinci kısmında öncelikle ölçümde dikkat edilmesi gereken zamansal hususlara yer verilmiştir. Önce ölçümün zamansal pozisyonunun geçmişte, gelecekte veya anlık olmasının sonuçlarına, sonrasında yönergede zamansal vurgudaki farkların sonuçlarına ve ölçümü nasıl etkilediğine dair çalışmalara değinilmiştir. Ardından duygunun deneyiminde yaşanan bireysel farklılıkların sistematik açıklamaları üzerinde durulmuştur. Duygunun ne ölçüde detaylı bir şekilde ifade edildiğine işaret eden duygusal detaycılık, farklı duyguların beraber yaşanma durumunu ifade eden duygusal diyalektisizm kavramları açıklanmıştır. Bu bireysel farklılıkların duygunun hem ölçümü hem de anlaşılmasına nasıl bir katkı sağlayabileceği ele alınmıştır. Tartışmada, duygunun öznel deneyimine dair farklı görüşler, zamansal hususların ve bireysel farklılıkların ölçüm için ne ifade edebileceği, ölçüm pratiklerinde nasıl katkılar sağlayabileceği tartışılmıştır.

Keywords

• Duyguyu ölçme
• öz bildirim
• duygunun öznel deneyimi
• duygusal deneyim
• duygunun fenomenolojisi

References

1. Adolphs, R. ve Anderson, D. J. (2018). The neuroscience of emotion: A new synthesis. Princeton University Press. https://doi.org/10.23943/9781400889914 google scholar
2. Afacan, Y. (2021). Impacts of biophilic design on the development of gerotranscendence and the Profile of Mood States during the COVID-19 pandemic. Ageing & Society, 1-25. https://doi.org/10.1017/ S0144686X21001860 google scholar
3. Arıkan İyilikci, E. ve Amado, S. (2018). The uncertainty appraisal enhances the prominent deck B effect in the Iowa gambling task. Motivation and Emotion, 42(1), 1-16. https://doi.org/10.1007/ s11031-017-9643-5 google scholar
4. Aydın, A., Araz, A.ve Asan, A. (2011). Görsel Analog Ölçeği ve Duygu Kafesi: Kültürümüze uyarlama çalışması. Türk Psikoloji Yazıları, 14 (27), 1-13. google scholar
5. Bachorowski, J. A. ve Owren, M. J. (1995). Vocal expression of emotion: Acoustic properties of speech are associated with motional intensity and context. Psychological Science, 6(4), 219-224. https:// doi.org/10.1111/j.1467-9280.1995.tb00596.x google scholar
6. Bagozzi, R. P., Wong, N. ve Yi, Y. (1999). The role of culture and gender in the relationship between positive and negative affect. Cognition and Emotion, 13(6), 641-672. https:// doi:10.1080/026999399379023 google scholar
7. Barrett, L. F. (2006a). Are emotions natural kinds? Perspectives on Psychological Science, 1(1), 28-58. https://doi:10.1111/j.1745-6916.2006.00003.x google scholar
8. Barrett, L. F. (2006b). Solving the emotion paradox: Categorization and the experience of emotion. Personality and Social Psychology Review, 10, 20-46. https://doi:10.1207/s15327957pspr1001_2 google scholar

9. Barrett, L. F., Gross, J., Christensen, T. C. ve Benvenuto, M. (2001). Knowing what you’re feeling and knowing what to do about it: Mapping the relation between emotion differentiation and emotion regulation. Cognition & Emotion, 15(6), 713-724. https://doi.org/10.1080/02699930143000239 google scholar
10. Barrett, L. F., Mesquita, B., Ochsner, K. N. ve Gross, J. J. (2007). The experience of emotion. Annual Review of Psychology, 58, 373-403. https://doi:10.1146/annurev.psych.58.110405.085709 google scholar
11. Barrett, L. F. ve Russell, J. A. (1999). The structure of current affect: Controversies and emerging consensus. Current Directions in Psychological Science, 8(1), 10-14. https://doi:10.1111/1467-8721.00003 google scholar
12. Bradley, M. M. ve Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49-59. https://doi:10.1016/0005-7916(94)90063-9 google scholar
13. Cacioppo, J. T., Berntson, G. G., Larsen, J. T., Poehlmann, K. M. ve Ito, T. A. (2000). The psychophysiology of emotion. M. Lewis ve J. M. Haviland-Jones (Ed.), Handbook of emotions içinde (2. Basım, s. 173-191). Guildford Press. google scholar
14. Campbell, D. T. ve Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81-105. https://doi.org/10.1037/h0046016 google scholar
15. Cannon, W. B. (1927). The James-Lange Theory of emotions: A critical examination and an alternative theory. The American Journal of Psychology, 39, 106-124. http://dx.doi.org/10.2307/1415404 google scholar
16. Carroll, J. M. ve Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70(2), 205-218. https:// doi:10.1037//0022-3514.70.2.205 google scholar
17. Carstensen, L. L., Pasupathi, M., Mayr, U. ve Nesselroade, J. R. (2000). Emotional experience in everyday life across the adult life span. Journal of Personality and Social Psychology, 79, 644-655. https://doi.org/10.1037/0022-3514.79.4.644 google scholar
18. Carstensen, L. L., Turan, B., Scheibe, S., Ram, N., Ersner-Hershfield, H., Samanez-Larkin, G. R., Brooks, K. P. ve Nesselroade, J. R. (2011). Emotional experience improves with age: evidence based on over 10 years of experience sampling. Psychology and Aging, 26(1), 21-33. https://doi. org/10.1037/a0021285 google scholar
19. Christopoulos, G. I., Uy, M. A. ve Yap, W. J. (2019). The body and the brain: Measuring skin conductance responses to understand the emotional experience. Organizational Research Methods, 22(1), 394420. https://doi.org/10.1177/1094428116681073 google scholar
20. Clark-Polner, E., Wager T. D., Satpute, A. B. ve Barrett, L. F. (2016). Neural fingerprinting: Meta-analysis, variation, and the search for brain-based essences in the science of emotion. Barrett L. F., Lewis M. ve Haviland-Jones J. M. (Ed.), The handbook of emotion içinde (4. basım, s. 146-165). The Guilford Press. google scholar
21. Coan, J. ve Allen, J. (2003). Varieties of emotional experience during voluntary emotional facial expressions. Annals of the New York Academy of Sciences, 1000(1), 375-379. https://doi. org/10.1196/annals.1280.034 google scholar
22. Cordaro, D. T., Sun, R., Keltner, D., Kamble, S., Huddar, N. ve McNeil, G. (2018). Universals and cultural variations in 22 emotional expressions across five cultures. Emotion, 18(1), 75-93. https:// doi.org/10.1037/emo0000302 google scholar
23. Desmet, P. (2003). Measuring emotion: Development and application of an instrument to measure emotional responses to products. Blythe, M.A., Overbeeke, K., Monk, A.F ve Wright, P.C. (Ed) Funology. Human-computer interaction series içinde (s. 111-123). Dordrecht. https://doi. org/10.1007/1-4020-2967-5_12 google scholar
24. Dinç, D. ve Aslan, A. (2017). Emotional and physiological reactions to classical Turkish music. Sobider, 4(16)., 294-304 http://dx.doi.org/10.16990/SOBIDER.3747 google scholar
25. Ekman, P. (1999). Basic emotions. T. Dalgleish ve M. J. Power (Ed.), Handbook of cognition and emotion içinde (s. 45-60). Erişim adresi: https://www.paulekman.com/wp-content/uploads/2013/07/ Basic-Emotions.pdf google scholar
26. Ekman, P. ve Friesen, W. V. (1978). Facial action coding system: Investigator’s guide. Consulting Psychologists Press. google scholar
27. Ekman, P., Friesen, W. V. ve Hager, J. C. (2002). Facial action coding system. Manual and investigator’s guide. Research Nexus. google scholar
28. Ekman, P., Levenson, R. W. ve Friesen, W. V. (1983). Autonomic nervous system activity distinguishes among emotions. Science, 221 (4616), 1208-1210. https://doi.org/10.1126/science.6612338 google scholar
29. Er, N. (2006). Duygu durum sıfat çiftleri listesi. Psikoloji Çalışmaları, 26, 21-44 google scholar
30. Erol-Korkmaz, H. T. (2019). Örgütsel çatışmaya yönelik bir günlük çalışması: Çatışmanın olumsuz etkilerini artıran unsurlar. Türk Psikoloji Dergisi, 34(83), 20-37. https://doi.org/10.31828/ tpd1300443320180124m000002 google scholar
31. Feldman, L. A. (1995). Valence focus and arousal focus: Individual differences in the structure of affective experience. Journal of Personality and Social Psychology, 69(1), 153-166. google scholar
32. Gardhouse, K. ve Anderson, A. K. (2013). Objective and subjective measurements in affective science. Armony J. ve Vuilleumier P. (Ed.), The Cambridge handbook of human affective neuroscience içinde (s. 57-81). Cambridge University Press. https://doi.org/10.1017/CBO9780511843716.005 google scholar
33. Garfinkel, S. N., Minati, L., Gray, M. A., Seth, A. K., Dolan, R. J. ve Critchley, H. D. (2014). Fear from the heart: Sensitivity to fear stimuli depends on individual heartbeats. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 34(19), 6573-6582. https://doi.org/10.1523/ JNEUROSCI.3507-13.2014 google scholar
34. Gençöz, T. (2000). Pozitif ve Negatif Duygu Ölçeği: Geçerlik ve güvenirlik çalışması. Türk Psikoloji Dergisi, 15(46), 19-26. google scholar
35. Gohm, C. L. ve Clore, G. L. (2000). Individual differences in emotional experience: Mapping available scales to processes. Personality and Social Psychology Bulletin, 26, 679-697. https:// doi:10.1177/0146167200268004 google scholar
36. Gray, E. K. ve Watson, D. (2007). Assessing positive and negative affect via self-report. Coan, J. A. ve. Allen, J. J. B (Ed.), Handbook of emotion elicitation and assessment içinde (s. 171-183). Oxford University Press. google scholar
37. Gök, A. C., Selçuk, E. ve Gençöz, T. (2018). Olumlu ve olumsuz duygulanımın tekrarlanan ölçümlerde kişi-içi güvenirliği. Türk Psikoloji Dergisi, 33(82), 53-66. https://doi.org/10.31828/ tpd13004433.2018.8202.04 google scholar
38. Hamann, S. (2012). Mapping discrete and dimensional emotions onto the brain: Controversies and consensus. Trends in Cognitive Sciences, 16(9), 458-466. https://doi.org/10.1016/j.tics.2012.07.006 google scholar
39. Harmon-Jones, C., Bastian, B. ve Harmon-Jones, E. (2016a). The discrete emotions questionnaire: A new tool for measuring state self-reported emotions. PLoS ONE, 11(8), e0159915. https://doi. org/10.1371/journal.pone.0159915 google scholar
40. Harmon-Jones, C., Bastian, B. ve Harmon-Jones, E. (2016b). Detecting transient emotional responses with improved self-report measures and instructions. Emotion, 16(7), 1086-1096. https:// doi:10.1037/emo0000216 google scholar
41. Izard, C. E. (2007). Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspectives on Psychological Science, 2, 260-280. https://doi:10.1111/j.1745-6916.2007.00044.x google scholar
42. Izard, C. E. (2010). The many meanings/Aspects of emotion: Definitions, functions, activation, and regulation. Emotion Review, 2(4), 363-370. https://doi:10.1177/1754073910374661 google scholar
43. Izard, C. E., Libero, D. Z., Putnam, P. ve Haynes, O. M. (1993). Stability of emotion experiences and their relations to traits of personality. Journal of Personality and Social Psychology, 64(5), 847860. https://doi:10.1037/0022-3514.64.5.847 google scholar
44. James, W. (1884). What is an emotion? Mind, 9(34), 188-205. Erişim adresi: https://www.jstor.org/ stable/2246769?seq=1#metadata_info_tab_contents google scholar
45. Kapucu, A., Arıkan İyilikçi, E., Eroğlu, S. ve Amado, A. (2018). Korku ve kızgınlık duygularının nötr kelimelere ilişkin tanıma belleği performansına etkileri. Türk Psikoloji Dergisi, 33(82), 85-89. https://doi.org/10.31828/tpd.13004433.2018.82.02.06 google scholar
46. Kaszniak, A. W., Reminger, S. L., Rapcsak, S. Z. ve Glisky, E. L. (1999). Conscious experience and autonomic response to emotional stimuli following frontal lobe damage. S. R. Hameroff, A.W. Kaszniak ve D. J. Chalmers (Ed.), Toward a science of consciousness: III. The third Tucson discussions and debates içinde (s. 201-213). https://doi:10.1016/s0898-1221(00)90179-2 google scholar
47. Kuppens, P. ve Tong, E. M. W. (2010). An appraisal account of individual differences in emotional experience. Social and Personality Psychology Compass, 4(12), 1138-1150. https://doi.org/10.1111/ j.1751-9004.2010.00324.x google scholar
48. LeDoux, J. (2003). The emotional brain, fear, and the amygdala. Cellular and Molecular Neurobiology, 23(4-5), 727-738. https://doi.org/10.1023/a:1025048802629 google scholar
49. LeDoux, J. E. (2017). Semantics, surplus meaning, and the science of fear. Trends in Cognitive Sciences, 21(5), 303-306. https://doi.org/10.1016/j.tics.2017.02.004 google scholar
50. Lindquist, K. A. ve Barrett, L. F. (2008). Emotional complexity. M. Lewis, J. M. Haviland-Jones ve L. F. Barrett (Ed.), Handbook of emotions içinde (s. 513-530). The Guilford Press. google scholar
51. Matsumoto, D., Keltner, D., Shiota, M. N., O’Sullivan, M. ve Frank, M. (2008). M. Lewis, J. M. Haviland-Jones ve L. F. Barrett (Ed.), Handbook of emotions içinde (s. 211-234). The Guilford Press. google scholar
52. Mauss, I. B., Levenson, R. W., McCarter, L., Wilhelm, F. H. ve Gross, J. J. (2005). The tie that binds? Coherence among emotion experience, behavior, and physiology. Emotion, 5(2), 175-190. https:// doi.org/10.1037/1528-3542.5.2.175 google scholar
53. Mauss, I. B. ve Robinson, M. D. (2009). Measures of emotion: A review. Cognition and Emotion, 23(2), 209-237. https://doi:10.1080/02699930802204677 google scholar
54. McNair, D., Lorr, M. ve Droppleman, L. (1992). Revised manual for the profile of mood states. Educational and Industrial Testing Services. google scholar
55. Moors, A. (2014). Flavors of appraisal theories of emotion. Emotion Review, 6(4), 303-307. https://doi. org/10.1177/1754073914534477 google scholar
56. Moors, A. (2020). Appraisal theory of emotion. Encyclopedia ofpersonality and individual differences içinde (s. 232-240). Springer International Publishing. google scholar
57. Nielsen, L.A. ve Kaszniak, A.W. (2006). Conceptual, theoretical, and methodological ıssues in inferring subjective emotion experience recommendations for researchers. Coan, J. A. ve Allen, J. J. (Ed.) Series in affective science: Handbook of emotion elicitation and assessment içinde (s. 361-375). Oxford University Press. google scholar
58. Panksepp, J. (2007). Neurologizing the psychology of affects: How appraisal-based constructivism and basic emotion theory can coexist. Perspectives on Psychological Science, 2(3), 281-295. https:// doi:10.1111/j.1745-6916.2007.00045.x google scholar
59. Pauen, M. ve Haynes, J. D. (2021). Measuring the mental. Consciousness and Cognition, 90, 103106. https://doi.org/10.1016/j.concog.2021.103106 google scholar
60. Peng, K. ve Nisbett, R. E. (1999). Culture, dialectics, and reasoning about contradiction. American Psychologist, 54(9), 741. https://doi.org/10.1037/0003-066X.54.9.741 google scholar
61. Perusini, J. N. ve Fanselow, M. S. (2015). Neurobehavioral perspectives on the distinction between fear and anxiety. Learning & Memory, 22(9), 417-425. https://doi.org/10.1101/lm.039180.115 google scholar
62. Quigley, K. S., Lindquist, K. A. ve Barrett, L. F. (2014). Inducing and measuring emotion and affect: Tips, tricks, and secrets. H. T. Reis ve C. M. Judd (Ed.), Handbook of research methods in social and personality psychology içinde (s. 220-252). Cambridge University Press google scholar
63. Rafaeli, E., Rogers, G. M. ve Revelle, W. (2007). Affective synchrony: Individual differences in mixed emotions. Personality and Social Psychology Bulletin, 33(7), 915-932. https://doi. org/10.1177/0146167207301009 google scholar
64. Reich, J. W., Zautra, A. J. ve Potter, P. T. (2001). Cognitive structure and the independence of positive and negative affect. Journal of Social and Clinical Psychology, 20, 99-115. https://doi:10.1521/ jscp.20.1.99.22255 google scholar
65. Reid, S. A. (2000). The experience of emotion in Parkinson’s disease and normal aging: Assessing the roles of facial expressiveness and cognitive functioning. Dissertation Abstracts International: Section B: The Sciences & Engineering, 60 (9), 4905. https://doi:10.4103/0976-3147.143197 google scholar
66. Robinson, M. D. ve Clore, G. L. (2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128(6), 934-960. https://doi:10.1037/0033-2909.128.6.934x google scholar
67. Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161-1178. https://doi:10.1037/h0077714 google scholar
68. Russell, J., Weiss, A. ve Mendelsohn, G. (1989). Affect grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology, 57, 493-502. https://doi:10.1037/0022-3514.57.3.493 google scholar
69. Schimmack, U., Oishi, S. ve Diener, E. (2002). Cultural influences on the relation between pleasant emotions and unpleasant emotions: Asian dialectic philosophies or individualism-collectivism?. Cognition & Emotion, 16(6), 705-719. https://doi.org/10.1037/0022-3514.82.4.582 google scholar
70. Searle, J. R. (1992). The rediscovery of the mind. The MIT Press. google scholar
71. Searle, J. R. (2000). Consciousness. Annual Review of Neuroscience, 23, 557-578. https://doi. org/10.1146/annurev.neuro.23.1.557 google scholar
72. Searle J. R. (2004). Mind: A brief introduction. Oxford University Press. google scholar
73. Selvi, Y., Güleç, M., Aydın, A. ve Beşiroğlu, L. (2011). Duygudurum Profili’nin (DP) Türkçe formunun psikometrik değerlendirmesi. Journal Of Mood Disorders, 1(4), 152-61. https://doi.org/10.5455/ jmood.20110902072033 google scholar
74. Selvi, Y., Kılıç, S., Aydın, A. ve Özdemir, P. G. (2015). The effects of sleep deprivation on dissociation and profiles of mood, and its association with biochemical changes. Nöro Psikiyatri Arşivi, 52(1), 83. https://doi.org/10.5152/npa.2015.7116 google scholar
75. Simon-Thomas, E. R., Keltner, D. J., Sauter, D., Sinicropi-Yao, L. ve Abramson, A. (2009). The voice conveys specific emotions: Evidence from vocal burst displays. Emotion, 9(6), 838-846. https://doi. org/10.1037/a0017810 google scholar
76. Solomon, R. L. ve Corbit, J. D. (1974). An opponent-process theory of motivation: I. Temporal dynamics of affect. Psychological Review, 81(2), 119-145. https://doi:10.1037/h0036128 google scholar
77. Spencer-Rodgers, J., Peng, K. ve Wang, L. (2010). Dialecticism and the co-occurrence of positive and negative emotions across cultures. Journal of Cross-Cultural Psychology, 41(1), 109-115. https:// doi.org/10.1177/0022022109349508 google scholar
78. Storbeck, J. ve Maswood, R. (2016). Happiness increases verbal and spatial working memory capacity where sadness does not: Emotion, working memory and executive control. Cognition & Emotion, 30(5), 925-938. https://doi.org/10.1080/02699931.2015.1034091 google scholar
79. Tugade, M. M., Fredrickson, B. L. ve Barrett, L. F. (2004). Psychological resilience and positive emotional granularity: Examining the benefits of positive emotions on coping and health. Journal ofPersonality, 72(6), 1161-1190. https://doi.org/10.1111/j.1467-6494.2004.00294.x google scholar
80. Vogel, E. K. ve Awh, E. (2008). How to exploit diversity for scientific gain: Using individual differences to constrain cognitive theory. Current Directions in Psychological Science, 17(2), 171-176. https:// doi:10.1111/j.1467-8721.2008.00569.x google scholar
81. Wackermann J. (2014). The long is not just a sum of the shorts: on time experienced and other times. Frontiers in psychology, 5, 516. https://doi.org/10.3389/fpsyg.2014.00516 google scholar
82. Watson, D. ve Clark, L.A. (1994). The PANAS-X manual for the positive and negative affect schedule. Erişim adresi: https://doi.org/10.17077/48VT-M4T2 google scholar
83. Watson, D., Clark, L. A. ve Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063-1070. https://doi:10.1037/0022-3514.54.6.1063 google scholar
84. Watson, D. ve Vaidya, J. (2003). Mood measurement: Current status and future directions. Schinka J. A. ve Velicer W. F. (Ed.), Handbook ofpsychology: Research methods in psychology içinde (s. 351375). John Wiley & Sons Inc. google scholar
85. Wilson, T. D. ve Gilbert, D. T. (2005). Affective forecasting: Knowing what to want. Current Directions in Psychological Science, 14(3), 131-134. https://doi:10.1111/j.0963-7214.2005.00355.x google scholar
86. Winkielman, P. ve Berridge, K. C. (2004). Unconscious emotion. Current Directions in Psychological Science, 13(3), 120-123. https://doi.org/10.1111/j.0963-7214.2004.00288.x google scholar
87. Yılmaz, T. ve Bekaroğlu, E. (2020). Ayrık Duygular Ölçeğinin Türkçeye uyarlama, güvenirlik ve geçerlik çalışması. Turkish Studies-Social Sciences, 15(4), 2233-2244. http://doi.org/10.29228/ TurkishStudies.40502 google scholar
88. Yüvrük, E., Kapucu, A. ve Amado, S. (2020). The effects of emotion on working memory: Valence versus motivation. Acta Psychologica, 202, 102983. https://doi.org/10.1016/j.actpsy.2019.102983 google scholar
89. Zautra, A. J., Berkhof, J. ve Nicolson, N. A. (2002). Changes in affect interrelations as a function of stressful events. Cognition & Emotion, 16(2), 309-318. https://doi.org/10.1080/02699930143000257 google scholar
90. Zuckerman, M. ve Lubin, B. (1965). Normative data for the Multiple Affect Adjective Check List. Psychological Reports, 16(2), 438. https://doi.org/10.2466/pr0.1965.16.2.438 google scholar