Automatic 4D facial expression recognition using DCT features
MetadataShow full item record
This paper addresses the problem of person-independent 4D facial expression recognition. Unlike the majority of existing works, we propose to extract spatio-temporal features in 4D data (3D expression sequences changing over time) to represent 3D facial expression dynamics sufficiently, rather than extracting features frame-by-frame. First, the proposed method extracts local depth patch-sequences from consecutive expression frames based on the automatically detected facial landmarks. Three dimension discrete cosine transform (3D-DCT) is then applied on these patch-sequences to extract spatio-temporal features for facial expression dynamic representation. Finally, the extracted compact features (3D-DCT coefficients) are fed to nearest-neighbor classifier to finish expression recognition after feature selection and dimension reduction, in which the redundant features are filtered out. Experiments on the benchmark BU-4DFE database show that the proposed method achieves the best average recognition rate 78.8% among the existing automatic approaches, and outperforms the existing techniques in the recognition of those easily confused expressions (anger and sadness) significantly.
Showing items related by title, author, creator and subject.
Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperatureKhan, Masood Mehmood; Ward, R. D.; Ingleby, M. (2009)Earlier researchers were able to extract the transient facial thermal features from thermal infrared images (TIRIs) to make binary distinctions between the expressions of affective states. However, effective human-computer ...
Xue, Mingliang; Mian, A.; Liu, Wan-Quan; Li, Ling (2014)Facial expressions form a significant part of our nonverbal communications and understanding them is essential for effective human computer interaction. Due to the diversity of facial geometry and expressions, automatic ...
Xue, Mingliang (2015)This thesis is to develop new facial expression recognition techniques based on 2D/3D images or videos, with the purpose to improve the recognition efficiency and accuracy of the current state-of-art. A fully automatic ...