Seyrek Ögrenme ile Yüz İşaret Yaması Bazlı Eylem Birimi Saptama

Öz

Yüz Eylem Kodlama Sistemi (FACS), bir kişinin hatta bir hayvanın duygusal dışa vurum ya da acı gibi yüz ifadelerini tanımlamada en çok kullanılan ve en yaygın olarak kabul gören standarttır. Bu sistemde yüzlerce Eylem Ünitesi (AU) kombinasyonu kullanılarak yüzdeki kas hareketleri tanımlanmaktadır.  Bu çalısmada yüz eylem ünitelerini yakalamak amacıyla yüz işaret noktalarından elde edilen imge yamalarıyla seyrek ögrenme tabanlı bir yöntem önerilmektedir. Önerilen yöntem bire karşı hepsi yaklaşımıyla tüm eylem üniteleri için ayrı ayrı en ayırt edici yüz işaret noktalarını çıkarmaktadır. CK+ veri kümesi üzerinde yapılan deneylerde, önerilen yöntemin son yıllarda yapılan yama bazlı çalışmaların çoğundan daha başarılı sonuç verdiği gözlenmiştir.

Anahtar Kelimeler

• eylem ünitesi saptama,seyrek öğrenme

Kaynakça

1. [1] Hjortsjö, Carl-Herman. Man's face and mimic language. Studen litteratur, 1969.
2. Ekman, Paul, Wallace V. Friesen. Facial action coding system. 1977.
3. Hager, J. C., P. Ekman, and W. V. Friesen. Facial action coding system. Salt Lake City, UT: A Human Face. ISBN 0-931835-01-1, 2002.
4. Lawrence Ian Reed, Michael A Sayette, and Jeffrey F Cohn. Impact of depression on response to comedy: a dynamic facial coding analysis. Journal of abnormal psychology, 116(4):804, 2007.
5. Amanda C Lints-Martindale, Thomas Hadjistavropoulos, Bruce Barber, and Stephen J Gibson. A psychophysical investigation of the facial action coding system as an index of pain variability among older adults with and without alzheimer’s disease. Pain Medicine, 8(8):678–689, 2007.
6. Patrick Lucey, Jeffrey F Cohn, Iain Matthews, Simon Lucey, Sridha Sridharan, Jessica Howlett, and Kenneth M Prkachin. Automatically detecting pain in video through facial action units. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 41(3):664–674, 2011.
7. Marina Davila-Ross, Goncalo Jesus, Jade Osborne, and Kim A Bard. Chimpanzees (pan troglodytes) produce the same types of ‘laugh faces’ when they emit laughter and when they are silent. PloS one, 10(6):e0127337, 2015.
8. Takuya Hashimoto, Sachio Hitramatsu, Toshiaki Tsuji, and Hiroshi Kobayashi. Development of the face robot saya for rich facial expressions. In SICE-ICASE, 2006. International Joint Conference, pages 5423–5428. IEEE, 2006.

9. Gianluca Donato, Marian Stewart Bartlett, Joseph C Hager, Paul Ekman, and Terrence J Sejnowski. Classifying facial actions. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 21(10):974–989, 1999.
10. Caifeng Shan, Shaogang Gong, and Peter W McOwan. Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing, 27(6):803–816, 2009.
11. Lin Zhong, Qingshan Liu, Peng Yang, Bo Liu, Junzhou Huang, and Dimitris N Metaxas. Learning active facial patches for expression analysis. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2562–2569. IEEE, 2012.
12. Li-Rong Zhong, Quanwei Liu, Ping Yang, Jie Huang, and Dimitris N Metaxas. Learning multiscale active facial patches for expression analysis. 2014.
13. Kaili Zhao, Wen-Sheng Chu, Fernando De la Torre, Jeffrey F Cohn, and Honggang Zhang. Joint patch and multi-label learning for facial action unit detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2207–2216, 2015.
14. Marian Stewart Bartlett, Joseph C Hager, Paul Ekman, and Terrence J Sejnowski. Measuring facial expressions by computer image analysis. Psychophysiology, 36(02):253–263, 1999.
15. Ping Liu, Joey Tianyi Zhou, Ivor Wai-Hung Tsang, Zibo Meng, Shizhong Han, and Yan Tong. Feature disentangling machine-a novel approach of feature selection and disentangling in facial expression analysis. In Computer Vision–ECCV 2014, pages 151–166. Springer, 2014.
16. Sima Taheri, Qiang Qiu, and Rama Chellappa. Structure-preserving sparse decomposition for facial expression analysis. Image Processing, IEEE Transactions on, 23(8):3590–3603, 2014.
17. Patrick Lucey, Jeffrey F Cohn, Takeo Kanade, Jason Saragih, Zara Ambadar, and Iain Matthews. The extended cohn-kanade dataset (ck+):A complete dataset for action unit and emotion-specified expression. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, pages 94–101. IEEE, 2010.
18. Xiangxin Zhu and Deva Ramanan. Face detection, pose estimation, and landmark localization in the wild. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2879–2886. IEEE, 2012.
19. Guoying Zhao and Matti Pietikainen. Dynamic texture recognition using local binary patterns with an application to facial expressions. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 29(6):915–928, 2007.
20. Corinna Cortes and Vladimir Vapnik. Support-vector networks. Machine learning, 20(3):273–297, 1995.
21. Ziheng Wang, Yongqiang Li, Shangfei Wang, and Qiang Ji. Capturing global semantic relationships for facial action unit recognition. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 3304–3311. IEEE, 2013.
22. Andreas Damianou, Carl Ek, Michalis Titsias, and Neil Lawrence. Manifold relevance determination. arXiv preprint arXiv:1206.4610, 2012.
23. Raquel Urtasun, Ariadna Quattoni, Neil Lawrence, and Trevor Darrell. Transferring nonlinear representations using gaussian processes with a shared latent space. 2008.
24. Stefanos Eleftheriadis, Ognjen Rudovic, and Maja Pantic. Discriminative shared gaussian processes for multiview and view-invariant facial expression recognition. Image Processing, IEEE Transactions on, 24(1):189–204, 2015.
25. Xiao Zhang, Mohammad H Mahoor, S Mohammad Mavadati, and Jeffrey F Cohn. A l p-norm mtmkl framework for simultaneous detection of multiple facial action units. In Applications of Computer Vision (WACV), 2014 IEEE Winter Conference on, pages 1104–1111. IEEE, 2014