Computing Publications

Publications Home » Facial Action Recognition for Fac...

Facial Action Recognition for Facial Expression Analysis from Static Face Images

Maja Pantic, Leon Rothkrantz

Journal Article
IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics
Volume 34
Issue 3
June, 2004
ISSN 1083-4419

Automatic recognition of facial gestures (i.e., facial muscle activity) is rapidly becoming an area of intense interest in the research field of machine vision. In this paper, we present an automated system that we developed to recognize facial gestures in static, frontal- and/or profile-view color face images. A multidetector approach to facial feature localization is utilized to spatially sample the profile contour and the contours of the facial components such as the eyes and the mouth. From the extracted contours of the facial features, we extract ten profile-contour fiducial points and 19 fiducial points of the contours of the facial components. Based on these, 32 individual facial muscle actions (AUs) occurring alone or in combination are recognized using rule-based reasoning. With each scored AU, the utilized algorithm associates a factor denoting the certainty with which the pertinent AU has been scored. A recognition rate of 86% is achieved.

PDF of full publication (810 kilobytes)
(need help viewing PDF files?)
BibTEX file for the publication
Conditions for downloading publications from this site. built & maintained by Ashok Argent-Katwala.