3D emotional facial animation synthesis with factored conditional Restricted Boltzmann Machines

Yong Zhao, Dongmei Jiang, Hichem Sahli

Research output: Chapter in Book/Report/Conference proceedingConference paper

3 Citations (Scopus)

Abstract

This paper presents a 3D emotional facial animation synthesis approach based on the Factored Conditional Restricted Boltzmann Machines (FCRBM). Facial Action Parameters (FAPs) extracted from 2D face image sequences, are adopted to train the FCRBM model parameters. Based on the trained model, given an emotion label sequence and several initial frames of FAPs, the corresponding FAP sequence is generated via the Gibbs sampling, and then used to construct the MPEG-4 compliant 3D facial animation. Emotion recognition and subjective evaluation on the synthesized animations show that the proposed method can obtain natural facial animations representing well the dynamic process of emotions. Besides, facial animation with smooth emotion transitions can be obtained by blending the emotion labels.
Original languageEnglish
Title of host publicationIEEE 6th International Conference on Affective Computing and Intelligent Interaction (ACII2015)
PublisherIEEE
Pages797-803
Number of pages6
ISBN (Electronic)978-1-4799-9953-8
Publication statusPublished - 2015
EventAffective Computing and Intelligent Interaction (ACII), 2015 International Conference on - China, Xi'an, China
Duration: 21 Sep 201524 Sep 2015

Conference

ConferenceAffective Computing and Intelligent Interaction (ACII), 2015 International Conference on
CountryChina
CityXi'an
Period21/09/1524/09/15

Keywords

  • emotion synthesis
  • Factored Conditional Restricted Boltzmann Machines

Fingerprint

Dive into the research topics of '3D emotional facial animation synthesis with factored conditional Restricted Boltzmann Machines'. Together they form a unique fingerprint.

Cite this