Bir hata meydana geldi.

Hata Kodu: #9965085

Lütfen ilgili hatayı hata kodu ile beraber ulakbim.dpdestek@tubitak.gov.tr adresine iletiniz.

Anasayfaya Dön

  1. DergiPark
  2. Journal of Soft Computing and Artificial Intelligence
  3. Arşiv
  4. Cilt 1, Sayı 1
Yıl 2020, Cilt 1 , Sayı 1, Sayfalar 1 - 17 2020-06-15

Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression

Mahmut DİRİK [1] , Oscar CASTILLO [2] , A. Fatih KOCAMAZ [3]

Öz

Automatic recognition of facial emotion plays an effective and important role in Human–Computer Interaction (HCI). There are various emotion recognition approaches have been proposed in the literature. The analytic face model consisted of a 26-dimensional geometric feature vector. These properties are used effectively to identify facial changes resulting from different expressions. The variation and uncertainties of these features make the emotion recognition problem more complicated. For decreasing these complications, we propose a distance-based clustering and uncertainty measures of the base new method for Emotion Recognition from Facial Expression using automatically selects 19 diagnostics of Action Units (AUs) in a 2D facial image using Type-2 Fuzzy inference system. The proposed system includes an automated generation scheme of the geometric facial feature vector. The proposed system has classified six facial expressions using the MUG Facial Expression database. The experimental results show that the proposed model is very efficient in uncertainty management policy and recognizes six basic emotions with an average precision rate of 86.175%.

Anahtar Kelimeler

Action Unit, Emotion Recognition, Facial Expression Recognition, Human–Computer Interaction, Interval Type-2 Fuzzy System

Kaynakça

  • C. Silva, A. Sobral, and R. T. Vieira, “An automatic facial expression recognition system evaluated by different classifiers,” no. October, 2014.
  • R. Contreras, O. Starostenko, and V. Alarcon-aquino, “Facial Feature Model for Emotion Recognition,” pp. 11–21, 2010.
  • O. Starostenko, R. Contreras, V. A. Aquino, and L. F. Pulido, “A Fuzzy Reasoning Model for Recognition of Facial Expressions,” vol. 15, no. 2, pp. 163–180, 2011.
  • A. J. Calder, A. M. Burton, P. Miller, A. W. Young, and S. Akamatsu, “A principal component analysis of facial expressions,” Vision Res., 2001.
  • M. H. Siddiqi, R. Ali, A. M. Khan, E. S. Kim, G. J. Kim, and S. Lee, “Facial expression recognition using active contour-based face detection, facial movement-based feature extraction, and non-linear feature selection,” Multimed. Syst., 2015.
  • S. Ulukaya and Ç. Eroǧlu Erdem, “Estimation of the neutral face shape using Gaussian mixture models,” in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2012.
  • D. Filko and G. Martinovic, “Emotion Recognition System by a Neural Network Based Facial Expression Analysis,” Autom. ‒ J. Control. Meas. Electron. Comput. Commun., 2013.
  • S. Jirayucharoensak, S. Pan-Ngum, and P. Israsena, “EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation,” Sci. World J., 2014.
  • Z. Yin, M. Zhao, Y. Wang, J. Yang, and J. Zhang, “Recognition of emotions using multimodal physiological signals and an ensemble deep learning model,” Comput. Methods Programs Biomed., 2017.
  • A. T. Lopes, E. de Aguiar, A. F. De Souza, and T. Oliveira-Santos, “Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order,” Pattern Recognit., 2017.
  • V. K. N. K. Kamlesh Pai, M. Balrai, S. Mogaveera, and D. Aeloor, “Face Recognition Using Convolutional Neural Networks,” in Proceedings of the 2nd International Conference on Trends in Electronics and Informatics, ICOEI 2018, 2018.
  • J. J. Lee, M. Zia Uddin, and T.-S. Kim, “spatiotemporal human facial expression recognition using fisher independent component analysis and Hidden Markov Model,” 2009.
  • J. Ou, X. B. Bai, Y. Pei, L. Ma, and W. Liu, “Automatic facial expression recognition using Gabor filter and expression analysis,” in ICCMS 2010 - 2010 International Conference on Computer Modeling and Simulation, 2010.
  • C. F. Chuang and F. Y. Shih, “Recognizing facial action units using independent component analysis and support vector machine,” Pattern Recognit., 2006.
  • A. Halder et al., “Reducing uncertainty in interval type-2 fuzzy sets for qualitative improvement in emotion recognition from facial expressions,” in IEEE International Conference on Fuzzy Systems, 2012.
  • A. Konar, A. Chakraborty, A. Halder, R. Mandal, and R. Janarthanan, “Interval type-2 fuzzy model for emotion recognition from facial expression,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2012, vol. 7143 LNCS, pp. 114–121.
  • A. Chakraborty, A. Konar, U. K. Chakraborty, and A. Chatterjee, “Emotion recognition from facial expressions and its control using fuzzy logic,” IEEE Trans. Syst. Man, Cybern. Part ASystems Humans, vol. 39, no. 4, pp. 726–743, 2009.
  • M. Ilbeygi and H. Shah-Hosseini, “A novel fuzzy facial expression recognition system based on facial feature extraction from color face images,” Eng. Appl. Artif. Intell., vol. 25, no. 1, pp. 130–146, Feb. 2012.
  • A. Halder, R. Mandal, A. Chakraborty, A. Konar, and R. Janarthanan, “Application of general type-2 fuzzy set in emotion recognition from facial expression,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011, vol. 7076 LNCS, no. PART 1, pp. 460–468.
  • A. Halder, R. Mandal, A. Konar, A. Chakraborty, and R. Janarthanan, “Emotion recognition from facial expression using general type-2 fuzzy set,” in 2011 International Conference on Recent Trends in Information Systems, ReTIS 2011 - Proceedings, 2011, pp. 263–268.
  • A. Halder, R. Mandal, A. Konar, A. Chakraborty, and R. Janarthanan, “Emotion Recognition from Facial Expression using General Type-2 Fuzzy Set,” pp. 263–268, 2011.
  • N. Esau, E. Wetzel, L. Kleinjohann, and B. Kleinjohann, “Real-Time Facial Expression Recognition Using Model Fuzzy Emotion,” 2007.
  • S. Ghosh and G. Paul, “A Type-2 Approach in Emotion Recognition and an Extended Type-2 Approach for Emotion Detection,” Fuzzy Inf. Eng., vol. 7, no. 4, pp. 475–498, Dec. 2015.
  • N. Esau, E. Wetzel, L. Kleinjohann, and B. Kleinjohann, “Real-time facial expression recognition using a fuzzy emotion model,” in IEEE International Conference on Fuzzy Systems, 2007.
  • D. Y. Liliana, B. T., and R. W. M., “Fuzzy Emotion Recognition Using Semantic Facial Features and Knowledge-based Fuzzy,” Int. J. Eng. Technol., vol. 11, no. 2, pp. 177–186, Apr. 2019.
  • J. M. Mendel, “Fuzzy sets for words: a new beginning,” 2004.
  • J. Mendel, “Type-2 Fuzzy Sets, A Tribal Parody [Discussion Forum,” IEEE Comput. Intell. Mag., 2010.
  • R. J. Davidson et al., “How are emotions distinguished from moods, temperament, and other related affective constructs?,” Nat. Emot. Fundam. Quest. Ser. Affect. Sci., 1994.
  • P. Ekman, “All Empotions Are Basic,” in The Nature of Emotion, 1994.
  • P. Ekman, “Moods, Emotions, and Traits,” The Nature of Emotion: Fundamental Questions. 1994.
  • P. Ekman, R. J. Davidson, M. Ricard, and B. A. Wallace, “Buddhist and psychological perspectives on emotions and well-being,” Curr. Dir. Psychol. Sci., 2005.
  • P. Ekman and W. V Friesen, “Facial action coding system: A technique for the measurement of facial movement.,” CA Consult. Psychol. Press. Ellsworth, PC, Smith, CA (1988). From Apprais. to Emot. Differ. among unpleasant Feel. Motiv. Emot., 1978.
  • P. Ekman and W. V. Friesen, The Facial Action Coding System. 1978.
  • P. Ekman and W. V Friesen, Unmasking the face: A guide to recognizing emotions from facial clues. 2003.
  • A. Majumder, L. Behera, and V. K. Subramanian, “Emotion recognition from geometric facial features using self-organizing map,” Pattern Recognit., vol. 47, no. 3, pp. 1282–1293, 2014.
  • P. Ekman, “Facial expression and emotion,” Am. Psychol., 1993.
  • P. Viola and M. J. Jones, “Robust Real-time Object Detection,” 2001.
  • P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” 2005.
  • K. W. Wan, K. M. Lam, and K. C. Ng, “An accurate active shape model for facial feature extraction,” Pattern Recognit. Lett., 2005.
  • Y. H. Lee, Y. Lee, D. S. Yang, J. H. Park, and Y. Kim, “Facial feature extraction using enhanced active shape model,” in 2013 International Conference on Information Science and Applications, ICISA 2013, 2013.
  • L. A. Zadeh, “Soft computing and fuzzy logic,” IEEE Softw., vol. 11, no. 6, pp. 48–56, 1994.
  • L.A.Zadeh, “A fuzzy -algorithmic approach to the definition of complex or imprecise concepts,” no. 8, pp. 249–291, 1976.
  • M. Dirik, O. Castillo, A. F. Kocamaz, M. Dirik, O. Castillo, and A. F. Kocamaz, “Visual-Servoing Based Global Path Planning Using Interval Type-2 Fuzzy Logic Control,” Axioms 2019, Vol. 8, Page 58, vol. 8, no. 2, p. 58, May 2019.
  • The MUG Facial Expression Database | Multimedia Understanding Group.” [Online]. Available: https://mug.ee.auth.gr/fed/. [Accessed: 06-Jul-2019].
  • O. Castillo, P. Melin, J. Kacprzyk, and W. Pedrycz, “Type-2 Fuzzy Logic: Theory and Applications,” in 2007 IEEE International Conference on Granular Computing (GRC 2007), 2007, pp. 145–145.
  • O. Castillo and P. Melin, “Hybrid intelligent systems for time series prediction using neural networks, fuzzy logic, and fractal theory,” IEEE Trans. Neural Networks, 2002.
  • J. M. Mendel, “Advances in type-2 fuzzy sets and systems,” Inf. Sci. (Ny)., 2007.

Ayrıntılar

Birincil Dil en
Konular Bilgisayar Bilimleri, Yapay Zeka
Bölüm Research Articles
Yazarlar

Orcid: 0000-0003-1718-5075
Yazar: Mahmut DİRİK
Kurum: SIRNAK UNIVERSITY
Ülke: Turkey

Orcid: 0000-0002-7385-5689
Yazar: Oscar CASTILLO
Kurum: Tıjuana
Ülke: Mexico

Orcid: 0000-0002-7729-8322
Yazar: A. Fatih KOCAMAZ
Kurum: İNÖNÜ ÜNİVERSİTESİ
Ülke: Turkey
Tarihler

Başvuru Tarihi : 3 Mayıs 2020
Kabul Tarihi : 3 Mayıs 2020
Yayımlanma Tarihi : 15 Haziran 2020

Kaynak Göster

Bibtex @araştırma makalesi { jscai731491, journal = {Journal of Soft Computing and Artificial Intelligence}, issn = {2717-8226}, address = {Tecde Mah. Gulay Sok. No 6:10/Malatya}, publisher = {Mahmut DİRİK}, year = {2020}, volume = {1}, pages = {1 - 17}, doi = {}, title = {Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression}, key = {cite}, author = {Dirik, Mahmut and Castıllo, Oscar and Kocamaz, A. Fatih} }
APA Dirik, M , Castıllo, O , Kocamaz, A . (2020). Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression . Journal of Soft Computing and Artificial Intelligence , 1 (1) , 1-17 . Retrieved from https://dergipark.org.tr/tr/pub/jscai/issue/54043/731491
MLA Dirik, M , Castıllo, O , Kocamaz, A . "Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression" . Journal of Soft Computing and Artificial Intelligence 1 (2020 ): 1-17 <https://dergipark.org.tr/tr/pub/jscai/issue/54043/731491>
Chicago Dirik, M , Castıllo, O , Kocamaz, A . "Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression". Journal of Soft Computing and Artificial Intelligence 1 (2020 ): 1-17
RIS TY - JOUR T1 - Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression AU - Mahmut Dirik , Oscar Castıllo , A. Fatih Kocamaz Y1 - 2020 PY - 2020 N1 - DO - T2 - Journal of Soft Computing and Artificial Intelligence JF - Journal JO - JOR SP - 1 EP - 17 VL - 1 IS - 1 SN - 2717-8226- M3 - UR - Y2 - 2020 ER -
EndNote %0 Journal of Soft Computing and Artificial Intelligence Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression %A Mahmut Dirik , Oscar Castıllo , A. Fatih Kocamaz %T Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression %D 2020 %J Journal of Soft Computing and Artificial Intelligence %P 2717-8226- %V 1 %N 1 %R %U
ISNAD Dirik, Mahmut , Castıllo, Oscar , Kocamaz, A. Fatih . "Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression". Journal of Soft Computing and Artificial Intelligence 1 / 1 (Haziran 2020): 1-17 .
AMA Dirik M , Castıllo O , Kocamaz A . Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression. JSCAI. 2020; 1(1): 1-17.
Vancouver Dirik M , Castıllo O , Kocamaz A . Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression. Journal of Soft Computing and Artificial Intelligence. 2020; 1(1): 1-17.
IEEE M. Dirik , O. Castıllo ve A. Kocamaz , "Emotion Recognition Based on Interval Type-2 Fuzzy Logic from Facial Expression", Journal of Soft Computing and Artificial Intelligence, c. 1, sayı. 1, ss. 1-17, Haz. 2020
Makalenin Yazarları
Mahmut DİRİK [1]
Oscar CASTILLO [2]
A. Fatih KOCAMAZ [3]
Makale Gönder
Arşiv
Editör Kurulu
İletişim

Creative Commons Lisansı
This work is licensed under a  Creative Commons Attribution 4.0 International License.