Year 2019, Volume 27 , Issue 3, Pages 1680 - 1695 2019-06-01

Efficient hierarchical temporal segmentation method for facial expression sequences

JIALI BIAN [1] , XUE MEI [2] , YU XUE [3] , LIANG WU [4] , YAO DING [5]


Temporal segmentation of facial expression sequences is important to understand and analyze human facial expressions. It is, however, challenging to deal with the complexity of facial muscle movements by finding a suitable metric to distinguish among different expressions and to deal with the uncontrolled environmental factors in the real world. This paper presents a two-step unsupervised segmentation method composed of rough segmentation and fine segmentation stages to compute the optimal segmentation positions in video sequences to facilitate the segmentation of different facial expressions. The proposed method performs localization of facial expression patches to aid in recognition and extraction of specific features. In the rough segmentation stage, facial sequences are segmented into distinct facial behaviors based on the similarity between sequence frames, while similarity between segments is computed to obtain optimal segmentation positions in the fine segmentation stage. The proposed method has been evaluated in experiments using the MMI dataset and real videos. Experiment results compared to other state-of-the-art methods indicate better performance of the proposed method.
Clustering, temporal segmentation, similarity calculation, facial image analysis
Journal Section Articles
Authors

Author: JIALI BIAN

Author: XUE MEI

Author: YU XUE

Author: LIANG WU

Author: YAO DING

Dates

Publication Date : June 1, 2019

Bibtex @ { tbtkelektrik577526, journal = {Turkish Journal of Electrical Engineering and Computer Science}, issn = {1300-0632}, eissn = {1303-6203}, address = {}, publisher = {TUBITAK}, year = {2019}, volume = {27}, pages = {1680 - 1695}, doi = {}, title = {Efficient hierarchical temporal segmentation method for facial expression sequences}, key = {cite}, author = {BIAN, JIALI and MEI, XUE and XUE, YU and WU, LIANG and DING, YAO} }
APA BIAN, J , MEI, X , XUE, Y , WU, L , DING, Y . (2019). Efficient hierarchical temporal segmentation method for facial expression sequences. Turkish Journal of Electrical Engineering and Computer Science , 27 (3) , 1680-1695 . Retrieved from https://dergipark.org.tr/en/pub/tbtkelektrik/issue/45742/577526
MLA BIAN, J , MEI, X , XUE, Y , WU, L , DING, Y . "Efficient hierarchical temporal segmentation method for facial expression sequences". Turkish Journal of Electrical Engineering and Computer Science 27 (2019 ): 1680-1695 <https://dergipark.org.tr/en/pub/tbtkelektrik/issue/45742/577526>
Chicago BIAN, J , MEI, X , XUE, Y , WU, L , DING, Y . "Efficient hierarchical temporal segmentation method for facial expression sequences". Turkish Journal of Electrical Engineering and Computer Science 27 (2019 ): 1680-1695
RIS TY - JOUR T1 - Efficient hierarchical temporal segmentation method for facial expression sequences AU - JIALI BIAN , XUE MEI , YU XUE , LIANG WU , YAO DING Y1 - 2019 PY - 2019 N1 - DO - T2 - Turkish Journal of Electrical Engineering and Computer Science JF - Journal JO - JOR SP - 1680 EP - 1695 VL - 27 IS - 3 SN - 1300-0632-1303-6203 M3 - UR - Y2 - 2019 ER -
EndNote %0 Turkish Journal of Electrical Engineering and Computer Science Efficient hierarchical temporal segmentation method for facial expression sequences %A JIALI BIAN , XUE MEI , YU XUE , LIANG WU , YAO DING %T Efficient hierarchical temporal segmentation method for facial expression sequences %D 2019 %J Turkish Journal of Electrical Engineering and Computer Science %P 1300-0632-1303-6203 %V 27 %N 3 %R %U
ISNAD BIAN, JIALI , MEI, XUE , XUE, YU , WU, LIANG , DING, YAO . "Efficient hierarchical temporal segmentation method for facial expression sequences". Turkish Journal of Electrical Engineering and Computer Science 27 / 3 (June 2019): 1680-1695 .
AMA BIAN J , MEI X , XUE Y , WU L , DING Y . Efficient hierarchical temporal segmentation method for facial expression sequences. Turkish Journal of Electrical Engineering and Computer Science. 2019; 27(3): 1680-1695.
Vancouver BIAN J , MEI X , XUE Y , WU L , DING Y . Efficient hierarchical temporal segmentation method for facial expression sequences. Turkish Journal of Electrical Engineering and Computer Science. 2019; 27(3): 1695-1680.