Projects per year
Abstract
Understanding social signals is a very important aspect of human communication and interaction and has therefore attracted increased attention from various research areas.
Among the different types of social signals, particular attention has been paid to facial expression of emotions and its automated analysis from image sequences.
Automated facial expression analysis is a very challenging task due to the complex three-dimensional deformation and motion of the face associated to
the facial expressions and the loss of 3D information during the image formation process.
As a consequence, retrieving 3D spatio-temporal facial information from image sequences is essential for automated facial expression analysis.
In this paper, we propose a framework for retrieving three-dimensional facial structure, motion and spatio-temporal features from monocular image sequences.
First, we estimate monocular 3D scene flow by retrieving the facial structure using shape-from-shading (SFS) and combine it with 2D optical flow.
Secondly, based on the retrieved structure and motion of the face, we extract spatio-temporal features for automated facial expression analysis.
Experimental results illustrate the potential of the proposed 3D facial information retrieval framework for facial expression analysis, i.e. facial expression recognition and facial action-unit recognition on a benchmark dataset. This paves the way for future research on monocular 3D facial expression analysis.
Original language | English |
---|---|
Title of host publication | International Conference on Affective Computing and Intelligent Interaction (ACII) 2015 |
Place of Publication | Xi'an, China |
Publisher | IEEE |
Pages | 623 - 629 |
DOIs | |
Publication status | Published - 2015 |
Event | Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on - China, Xi'an, China Duration: 21 Sep 2015 → 24 Sep 2015 |
Conference
Conference | Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on |
---|---|
Country | China |
City | Xi'an |
Period | 21/09/15 → 24/09/15 |
Keywords
- Facial Expression Analysis
- Shape-from- Shading
- 3D Scene Flow Estimation
- Bag-of-Visual-Words
- Multiple Instance Learning
Fingerprint
Dive into the research topics of 'Monocular 3D Facial Information Retrieval for Automated Facial Expression Analysis'. Together they form a unique fingerprint.-
SRP11: Strategic Research Programme: Processing of large scale multi-dimensional, multi-spectral, multi-sensorial and distributed data (M³D²)
Schelkens, P., Deligiannis, N., Jansen, B., Kuijk, M., Munteanu, A., Sahli, H., Steenhaut, K., Stiens, J., Schelkens, P., Cornelis, J. P., Kuijk, M., Munteanu, A., Sahli, H., Stiens, J. & Vounckx, R.
1/11/12 → 31/12/23
Project: Fundamental
-
OZR2709: International Joint Research Group - Joint Laboratory on Audio Visual Signal Processing
Sahli, H. & Zhang, Y.
3/12/14 → 2/12/20
Project: Fundamental
-
IRP5: Objectifying Assessment of Human Emotional Processing and Expression of Clinical and Psychotherapy Applications (EMO-App)
Sahli, H., Vandekerckhove, M. & Kerckhofs, E.
1/04/13 → 31/03/18
Project: Fundamental