A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Citations Over TimeTop 1% of 2008 papers
Abstract
Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions despite the fact that deliberate behaviour differs in visual appearance, audio profile, and timing from spontaneously occurring behaviour. To address this problem, efforts to develop algorithms that can process naturally occurring human affective behaviour have recently emerged. Moreover, an increasing number of efforts are reported toward multimodal fusion for human affect analysis including audiovisual fusion, linguistic and paralinguistic fusion, and multi-cue visual fusion based on facial expressions, head movements, and body gestures. This paper introduces and surveys these recent advances. We first discuss human emotion perception from a psychological perspective. Next we examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data. We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.
Related Papers
- → AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild(2017)2,063 cited
- → Affective state detection via facial expression analysis within a human–computer interaction context(2017)66 cited
- → Affective facial expressions recognition for human-robot interaction(2017)44 cited
- → Analysis of Human-Machine Interaction Through Facial Expression and Hand-Gesture Recognition(2019)4 cited
- → A Review of Emotions Recognition via Facial Expressions for Human-Robot Interaction(2023)1 cited