3D Facial Landmark Detection under Large Yaw and Expression Variations

Citations Over TimeTop 10% of 2012 papers

Abstract

A 3D landmark detection method for 3D facial scans is presented and thoroughly evaluated. The main contribution of the presented method is the automatic and pose-invariant detection of landmarks on 3D facial scans under large yaw variations (that often result in missing facial data), and its robustness against large facial expressions. Three-dimensional information is exploited by using 3D local shape descriptors to extract candidate landmark points. The shape descriptors include the shape index, a continuous map of principal curvature values of a 3D object's surface, and spin images, local descriptors of the object's 3D point distribution. The candidate landmarks are identified and labeled by matching them with a Facial Landmark Model (FLM) of facial anatomical landmarks. The presented method is extensively evaluated against a variety of 3D facial databases and achieves state-of-the-art accuracy (4.5-6.3 mm mean landmark localization error), considerably outperforming previous methods, even when tested with the most challenging data.

Related Papers

• → Optimal landmark distributions for statistical shape model construction(2006)24 cited
• → Automatic Generation of 3D Statistical Shape Models with Optimal Landmark Distributions(2007)22 cited
• → Multimodal Point Distribution Model for Anthropological Landmark Detection(2019)2 cited
• Facial Landmark Detection and Localization Using Point Distribution Model(2017)
• → Self-supervised Landmark Learning with Deformation Reconstruction and Cross-subject Consistency Objectives(2023)