Training deep networks for facial expression recognition with crowd-sourced label distribution

Citations Over TimeTop 1% of 2016 papers

Abstract

Crowd sourcing has become a widely adopted scheme to collect ground truth labels. However, it is a well-known problem that these labels can be very noisy. In this paper, we demonstrate how to learn a deep convolutional neural network (DCNN) from noisy labels, using facial expression recognition as an example. More specifically, we have 10 taggers to label each input image, and compare four different approaches to utilizing the multiple labels: majority voting, multi-label learning, probabilistic label drawing, and cross-entropy loss. We show that the traditional majority voting scheme does not perform as well as the last two approaches that fully leverage the label distribution. An enhanced FER+ data set with multiple labels for each face image will also be shared with the research community.

Related Papers

• → Personalized facial expression recognition in indoor environments(2010)23 cited
• → Real-time facial expression recognitions: A review(2009)12 cited
• → Facial Expression Recognition Using Thermal Image Processing and Efficient Preparation of Training-data(2015)6 cited
• A Survey of Facial Expression Recognition(2012)
• → Development of a Facial Expression Recognition and Expression Skill Training System for ASD Children(2021)2 cited