Emotion Analysis using Different Stimuli with EEG Signals in Emotional Space
Year 2017,
Volume: 2 Issue: 2, 1 - 10, 20.07.2017
Yaşar Daşdemir
,
Esen Yıldırım
Serdar Yıldırım
Abstract
Automatic detection for human-machine interfaces of the emotional states of the people is one of the difficult tasks. EEG signals that are very difficult to control by the person are also used in emotion recognition tasks. In this study, emotion analysis and classification study were conducted by using EEG signals for different types of stimuli. The combination of the audio and video information has been shown to be more effective about the classification of positive/negative (high/low) emotion by using wavelet transform from EEG signals, and true positive rate of 81.6% was obtained in valence dimension. Information of audio was found to be more effective than the information of video at classification that is made in arousal dimension, and true positive rate of 73.7% was obtained when both stimuli of audio and audio+video are used. Four class classification performance has also been examined in the space of valence-arousal.
References
- Ahmed, M. A. (2014). Emotion Recognition Based on Correlation Between Left and Right Frontal EEG Assymetry. Mecatronics (MECATRONICS), 99–103.
- Al-galal, S. A. Y., Taha, I. F., & Wahab, A. (2015). Relaxing Music Using Valence-Arousal Model. Içinde 4th International Conference on Advanced Computer Science Applications and Technologies (ss. 9–14).
- Atkinson, J., & Campos, D. (2016). Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers R. Expert Systems With Applications, 47, 35–41. http://doi.org/10.1016/j.eswa.2015.10.049
- Bradley, M. M., & Lang, P. J. (1999). International Affective Digitized Sounds (IADS): Stimuli, Instruction Manual and Affective Ratings. Technical Report B-2, Gainesville, FL:The Center for Research in Psychophysiology, University of Florida, FL, USA.
- Chen, M., & Han, J. (2015). Identifying Valence and Arousal Levels via Connectivity between EEG Channels. Içinde International Conference on Affective Computing and Intelligent Interaction (ACII) (ss. 63–69).
- Ekman, P. (1999). Basic Emotions. Içinde Handbook of Cognition and Emotion (Dalgleish, ss. 45–60). New York: John Wiley&Sons Ltd.
- Gunes, H., & Pantic, M. (2010). Automatic , Dimensional and Continuous Emotion recognition. International Journal of Synthetic Emotions, 1(1), 68–99.
- Huang, X., Kortelainen, J., Zhao, G., Li, X., Moilanen, A., Seppänen, T., & Pietikäinen, M. (2016). Multi-modal emotion analysis from facial expressions and electroencephalogram. Computer Vision and Image Understanding, 147, 114–124.
- Koelstra, S., Mühl, C., Soleymani, M., Lee, J. S., Yazdani, A., Ebrahimi, T., … Patras, I. (2012). DEAP: A database for emotion analysis; Using physiological signals. IEEE Transactions on Affective Computing, 3(1), 18–31.
- Kumar, N., Khaund, K., & Hazarika, S. M. (2016). Bispectral Analysis of EEG for Emotion Recognition. Procedia - Procedia Computer Science, 84, 31–35. http://doi.org/10.1016/j.procs.2016.04.062
- Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). International affective picture system (IAPS): Technical manual and affective ratings. University of Florida.
- Liu, Y., & Sourina, O. (2012). EEG-based Valence Level Recognition for Real-Time Applications. Içinde International Conference on Cyberworlds (ss. 53–60).
- Morris, J. D. (1995). Observations: SAM: the Self-Assessment Manikin; an efficient cross-cultural measurement of emotional response. Journal of advertising research, 35(6), 63–68.
- Ramirez, R., & Vamvakousis, Z. (2012). Detecting Emotion from EEG Signals Using the Emotive Epoc Device. Içinde Brain Informatics (ss. 175–184).
- Rottenberg, J., Ray, R. D., & Gross, J. J. (2007). Emotion elicitation using films. Içinde The handbook of emotion elicitation and assessment (ss. 9–28). Oxford University Press.
- Srinivas, V., Rama, V., & Rao, C. B. R. (2016). Wavelet Based Emotion Recognition Using RBF Algorithm. International Journal of Innovative Research in Electrical, Electronics, Instrumentation and Control Engineering, 4(5), 29–34.
- Winkler, I., Haufe, S., & Tangermann, M. (2011). Automatic Classification of Artifactual ICA-Components for Artifact
Removal in EEG Signals. Behavioral and Brain Functions, 7(1), 30.
- Xu, H., & Plataniotis, K. N. K. (2012). Affect Recognition Using EEG Signal. Içinde MMSP 2012 (ss. 299–304).
- Yohanes, R. E. J., Member, S., Ser, W., Member, S., Huang, G., & Member, S. (2012). Discrete Wavelet Transform Coefficients for Emotion Recognition from EEG Signals. Içinde 34th Annual International Conference of the IEEE EMBS (ss. 2251–2254).
- Yoon, H. J., & Chung, S. Y. (2011). EEG Spectral Analysis in Valence and Arousal Dimensions of Emotion. Içinde 11th International Conference on Control, Automation and Systems (ss. 1319–1322).
Year 2017,
Volume: 2 Issue: 2, 1 - 10, 20.07.2017
Yaşar Daşdemir
,
Esen Yıldırım
Serdar Yıldırım
References
- Ahmed, M. A. (2014). Emotion Recognition Based on Correlation Between Left and Right Frontal EEG Assymetry. Mecatronics (MECATRONICS), 99–103.
- Al-galal, S. A. Y., Taha, I. F., & Wahab, A. (2015). Relaxing Music Using Valence-Arousal Model. Içinde 4th International Conference on Advanced Computer Science Applications and Technologies (ss. 9–14).
- Atkinson, J., & Campos, D. (2016). Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers R. Expert Systems With Applications, 47, 35–41. http://doi.org/10.1016/j.eswa.2015.10.049
- Bradley, M. M., & Lang, P. J. (1999). International Affective Digitized Sounds (IADS): Stimuli, Instruction Manual and Affective Ratings. Technical Report B-2, Gainesville, FL:The Center for Research in Psychophysiology, University of Florida, FL, USA.
- Chen, M., & Han, J. (2015). Identifying Valence and Arousal Levels via Connectivity between EEG Channels. Içinde International Conference on Affective Computing and Intelligent Interaction (ACII) (ss. 63–69).
- Ekman, P. (1999). Basic Emotions. Içinde Handbook of Cognition and Emotion (Dalgleish, ss. 45–60). New York: John Wiley&Sons Ltd.
- Gunes, H., & Pantic, M. (2010). Automatic , Dimensional and Continuous Emotion recognition. International Journal of Synthetic Emotions, 1(1), 68–99.
- Huang, X., Kortelainen, J., Zhao, G., Li, X., Moilanen, A., Seppänen, T., & Pietikäinen, M. (2016). Multi-modal emotion analysis from facial expressions and electroencephalogram. Computer Vision and Image Understanding, 147, 114–124.
- Koelstra, S., Mühl, C., Soleymani, M., Lee, J. S., Yazdani, A., Ebrahimi, T., … Patras, I. (2012). DEAP: A database for emotion analysis; Using physiological signals. IEEE Transactions on Affective Computing, 3(1), 18–31.
- Kumar, N., Khaund, K., & Hazarika, S. M. (2016). Bispectral Analysis of EEG for Emotion Recognition. Procedia - Procedia Computer Science, 84, 31–35. http://doi.org/10.1016/j.procs.2016.04.062
- Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). International affective picture system (IAPS): Technical manual and affective ratings. University of Florida.
- Liu, Y., & Sourina, O. (2012). EEG-based Valence Level Recognition for Real-Time Applications. Içinde International Conference on Cyberworlds (ss. 53–60).
- Morris, J. D. (1995). Observations: SAM: the Self-Assessment Manikin; an efficient cross-cultural measurement of emotional response. Journal of advertising research, 35(6), 63–68.
- Ramirez, R., & Vamvakousis, Z. (2012). Detecting Emotion from EEG Signals Using the Emotive Epoc Device. Içinde Brain Informatics (ss. 175–184).
- Rottenberg, J., Ray, R. D., & Gross, J. J. (2007). Emotion elicitation using films. Içinde The handbook of emotion elicitation and assessment (ss. 9–28). Oxford University Press.
- Srinivas, V., Rama, V., & Rao, C. B. R. (2016). Wavelet Based Emotion Recognition Using RBF Algorithm. International Journal of Innovative Research in Electrical, Electronics, Instrumentation and Control Engineering, 4(5), 29–34.
- Winkler, I., Haufe, S., & Tangermann, M. (2011). Automatic Classification of Artifactual ICA-Components for Artifact
Removal in EEG Signals. Behavioral and Brain Functions, 7(1), 30.
- Xu, H., & Plataniotis, K. N. K. (2012). Affect Recognition Using EEG Signal. Içinde MMSP 2012 (ss. 299–304).
- Yohanes, R. E. J., Member, S., Ser, W., Member, S., Huang, G., & Member, S. (2012). Discrete Wavelet Transform Coefficients for Emotion Recognition from EEG Signals. Içinde 34th Annual International Conference of the IEEE EMBS (ss. 2251–2254).
- Yoon, H. J., & Chung, S. Y. (2011). EEG Spectral Analysis in Valence and Arousal Dimensions of Emotion. Içinde 11th International Conference on Control, Automation and Systems (ss. 1319–1322).