Skip to main content
Artificial Intelligence

An open vision-language model for diverse medical applications

| Source: Nature Medicine

Abstract Artificial intelligence has high potential for impact in healthcare applications, but its training and deployment are challenging due to diverse data, a complex spectrum of possible tasks and important privacy needs. High-performing foundation models that enable data-efficient fine-tuning for diverse downstream tasks can meaningfully accelerate development in this domain. We introduce MedGemma, a collection of medical vision-language foundation models based on Gemma 3. MedGemma demonstr

Abstract Artificial intelligence has high potential for impact in healthcare applications, but its training and deployment are challenging due to diverse data, a complex spectrum of possible tasks and important privacy needs. High-performing foundation models that enable data-efficient fine-tuning for diverse downstream tasks can meaningfully accelerate development in this domain. We introduce MedGemma, a collection of medical vision-language foundation models based on Gemma 3. MedGemma demonstrates advanced medical understanding and reasoning across images and text and multiple medical imaging domains, exceeding the performance of similarly sized generative models while maintaining the general capabilities of the Gemma base models. For out-of-distribution tasks, MedGemma achieves improvements of 2.6–10% in medical image question answering, 15.5–18.1% in chest X-ray finding classification and 10.8% in agentic evaluations compared with the base models. Our results show that fine-tuning MedGemma can be more effective than fine-tuning the base Gemma 3 model for medical tasks, particularly in the setting of limited training data. We additionally introduce MedSigLIP, a medically tuned vision encoder derived from SigLIP. MedSigLIP powers the visual understanding capabilities of MedGemma and, as an encoder, achieves performance comparable to or better than that of many specialized medical image encoders. Taken together, the MedGemma collection provides a strong foundation of medical image and text capabilities, with the potential to accelerate medical research and the development of downstream applications.

Read the original source →

Related Stories

Artificial Intelligence

Integrating cooperative breeding with reciprocity and culture extends Hamilton's rule to humans.

We study how kinship and reciprocity shape giving and child care support in societies with limited access to markets. Extending Hamilton's rule to incorporate reciprocity, we test it using behavioral data from dictator games and surveys in remote matrilocal and patrilocal villages of northeast India (N = 406 parents of young children). We replicate with data from urban Manila neighborhoods (N = 301) and the Solomon Islands (N = 624). Consistent with predictions, transfers to recipients increase

Continue reading
Artificial Intelligence

A microexon regulatory code reveals autism-linked genetic variation.

Neuronal microexons are a highly conserved class of alternative splicing events enriched in genes with critical functions in nervous system biology 1,2 . Microexon splicing is often disrupted in the brains of autistic individuals, and mice with microexon deficiencies display autism-like phenotypes 1,3,4 . However, the full landscape of microexons is not known, and the impact of genetic variation on these exons has not been systematically investigated. Here, through extensive transcriptome profil

Continue reading
Artificial Intelligence

Deep learning of fossil pollen morphology reveals 25,000 y of ecological change in eastern African grasslands.

Grass (Poaceae) pollen is largely overlooked in investigations of grassland evolution because the pollen of most species cannot be differentiated using traditional optical microscopy. However, the combination of superresolution microscopy and deep learning enables the capture and quantification of distinct morphological variation across the pollen of grass species. Using a semisupervised deep-learning strategy, we trained convolutional neural networks (CNNs) on superresolution images of known mo

Continue reading
Artificial Intelligence

Tyrosine phosphorylation unfolds nucleophosmin and disrupts its integration into the nucleolus.

Nucleophosmin (NPM1) is a multifunctional nucleolar protein essential for ribosome biogenesis, genome stability, and stress responses. Its integration into the nucleolus depends on its oligomerization and multivalent interactions that enable liquid-liquid phase separation (LLPS). Here, we investigate how tyrosine phosphorylation at Tyr17, Tyr29, and Tyr67 located within the interface between monomers at the N-terminal oligomerization domain regulates NPM1 structure and function. Replacing tyrosi

Continue reading
Artificial Intelligence

Human-artificial intelligence collaboration for comanaging epilepsy in real time.

One-third of the world's 70 million people with epilepsy have seizures uncontrolled by medication, and implantable devices are a promising treatment. These devices can detect impending seizures, missed medication and impaired cognition, but, like most medical devices, they cannot share this information with patients in real time. This is a missed opportunity for devices to learn from clinical events and teach patients how their behaviors affect their health. Here we present a device platform tha

Continue reading