Coding, analysis, interpretation, and recognition of facial expressions

Citations Over TimeTop 1% of 1997 papers

Abstract

We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with geometric, physical and motion-based dynamic models describing the facial structure. Our method produces a reliable parametric representation of the face's independent muscle action groups, as well as an accurate estimate of facial motion. Previous efforts at analysis of facial expression have been based on the facial action coding system (FACS), a representation developed in order to allow human psychologists to code expression from static pictures. To avoid use of this heuristic coding scheme, we have used our computer vision system to probabilistically characterize facial motion and muscle activation in an experimental population, thus deriving a new, more accurate, representation of human facial expressions that we call FACS+. Finally, we show how this method can be used for coding, analysis, interpretation, and recognition of facial expressions.

Related Papers

• → Thermal Analysis of Facial Muscles Contractions(2011)79 cited
• → Disturbance of spontaneous and posed facial expressions in Parkinson's disease(2003)57 cited
• → Objective evaluation of the relationship between facial expression analysis by the facial action coding system (FACS) and CT/MRI analyses of the facial expression muscles(2020)5 cited
• → Thermal imaging of facial expressions: investigating thermal correlates of Facial Action Units activities(2008)1 cited
• → Study of expression in virtual character of facial smile by emotion recognition(2013)