OpenCap: Human movement dynamics from smartphone videos

Citations Over TimeTop 1% of 2023 papers

Abstract

Measures of human movement dynamics can predict outcomes like injury risk or musculoskeletal disease progression. However, these measures are rarely quantified in large-scale research studies or clinical practice due to the prohibitive cost, time, and expertise required. Here we present and validate OpenCap, an open-source platform for computing both the kinematics (i.e., motion) and dynamics (i.e., forces) of human movement using videos captured from two or more smartphones. OpenCap leverages pose estimation algorithms to identify body landmarks from videos; deep learning and biomechanical models to estimate three-dimensional kinematics; and physics-based simulations to estimate muscle activations and musculoskeletal dynamics. OpenCap's web application enables users to collect synchronous videos and visualize movement data that is automatically processed in the cloud, thereby eliminating the need for specialized hardware, software, and expertise. We show that OpenCap accurately predicts dynamic measures, like muscle activations, joint loads, and joint moments, which can be used to screen for disease risk, evaluate intervention efficacy, assess between-group movement differences, and inform rehabilitation decisions. Additionally, we demonstrate OpenCap's practical utility through a 100-subject field study, where a clinician using OpenCap estimated musculoskeletal dynamics 25 times faster than a laboratory-based approach at less than 1% of the cost. By democratizing access to human movement analysis, OpenCap can accelerate the incorporation of biomechanical metrics into large-scale research studies, clinical trials, and clinical practice.

Related Papers

• → Effects of movement direction upon kinematic characteristics of vertical arm pointing movements in man(1998)94 cited
• → The assessment of movement patterns of children practicing karate using the Functional Movement Screen test(2015)14 cited
• → Comparative Analysis of Biomechanical Variables in Marker-based and Markerless Motion Capture Systems(2023)5 cited
• → Quantification of dance movement by simultaneous measurement of body motion and biophysical information(2007)13 cited
• → Evaluation of action sport camera optical motion capture system for 3D gait analysis(2021)4 cited