Foundation models for generalist medical artificial intelligence
Citations Over TimeTop 1% of 2023 papers
Abstract
The exceptionally rapid development of highly flexible, reusable artificial intelligence (AI) models is likely to usher in newfound capabilities in medicine. We propose a new paradigm for medical AI, which we refer to as generalist medical AI (GMAI). GMAI models will be capable of carrying out a diverse set of tasks using very little or no task-specific labelled data. Built through self-supervision on large, diverse datasets, GMAI will flexibly interpret different combinations of medical modalities, including data from imaging, electronic health records, laboratory results, genomics, graphs or medical text. Models will in turn produce expressive outputs such as free-text explanations, spoken recommendations or image annotations that demonstrate advanced medical reasoning abilities. Here we identify a set of high-impact potential applications for GMAI and lay out specific technical capabilities and training datasets necessary to enable them. We expect that GMAI-enabled applications will challenge current strategies for regulating and validating AI devices for medicine and will shift practices associated with the collection of large medical datasets.
Related Papers
- → Interruptions as multimodal outputs: which are the less disruptive?(2003)69 cited
- → Beyond a Generic Complementary and Alternative Medicine: The Holistic Health Care- Conventional Medicine Continuum(2009)8 cited
- → Some Issues on Choices of Modalities for Multimodal Biometric Systems(2014)1 cited
- → The Effect of Teaching Practical Physical Modalities on the Ordering Skills of Physical Medicine and Rehabilitation Residents(2013)
- → SHAPE: An Unified Approach to Evaluate the Contribution and Cooperation of Individual Modalities(2022)