Deepfakes for Medical Video De-Identification

Citations Over TimeTop 10% of 2020 papers

Abstract

Data sharing for medical research has been difficult as open-sourcing clinical data may violate patient privacy. Traditional methods for face de-identification wipe out facial information entirely, making it impossible to analyze facial behavior. Recent advancements on whole-body keypoints detection also rely on facial input to estimate body keypoints. Both facial and body keypoints are critical in some medical diagnoses, and keypoints invariability after de-identification is of great importance. Here, we propose a solution using deepfake technology, the face swapping technique. While this swapping method has been criticized for invading privacy and portraiture right, it could conversely protect privacy in medical video: patients' faces could be swapped to a proper target face and become unrecognizable. However, it remained an open question that to what extent the swapping de-identification method could affect the automatic detection of body keypoints. In this study, we apply deepfake technology to Parkinson's disease examination videos to de-identify subjects, and quantitatively show that: face-swapping as a de-identification approach is reliable, and it keeps the keypoints almost invariant, significantly better than traditional methods. This study proposes a pipeline for video de-identification and keypoint preservation, clearing up some ethical restrictions for medical data sharing. This work could make open-source high quality medical video datasets more feasible and promote future medical research that benefits our society.

Related Papers

• → To Think Is Good: Querying an Initial Hypothesis Reduces Diagnostic Error in Medical Students(2010)50 cited
• → The Reliability of Medical History and Physical Examination in Patients with Acute Abdominal Pain(1983)31 cited
• → Diagnoses from an On-Line Expert System for Chronic Pain Confirmed by IntraOperative Findings(2016)7 cited
• → Assessment of Text Documentation Accompanying Uncoded Diagnoses in Computerized Health Insurance Claims in Japan(2015)4 cited
• → Accuracy in recorded diagnoses(1992)9 cited