Related Experiment Video
Updated: Oct 5, 2026

Co-analysis of Brain Structure and Function using fMRI and Diffusion-weighted Imaging
Published on: November 8, 2012
Cortex-grounded diffusion models for brain image generation
Fabian Bongratz1, Yitong Li1, Sama Elbaroudy2
1Lab for AI in Medical Imaging, Institute for Diagnostic and Interventional Radiology, Technical University of Munich, School of Medicine and Health, TUM University Hospital, Munich, Germany; Munich Center for Machine Learning (MCML), Munich, Germany.
Abstract:
Synthetic neuroimaging data can mitigate critical limitations of real-world datasets, including the scarcity of rare phenotypes, domain shifts across scanners, and insufficient longitudinal coverage. However, existing generative models largely rely on weak conditioning signals, such as labels or text, which lack anatomical grounding and often produce biologically implausible outputs. To this end, we introduce Cor2Vox, a cortex-grounded generative framework for brain magnetic resonance image (MRI) synthesis that ties image generation to continuous structural priors of the cerebral cortex. It leverages high-resolution cortical surfaces to guide a 3D shape-to-image Brownian bridge diffusion process, enabling topologically faithful synthesis and precise control over underlying anatomies. To support the generation of new, realistic brain shapes, we developed a large-scale statistical shape model of cortical morphology derived from over 33,000 UK Biobank scans. We validated the fidelity of Cor2Vox based on traditional image quality metrics, advanced cortical surface reconstruction, and whole-brain segmentation quality, outperforming many baseline methods. Across three applications, namely (i) anatomy-guided synthesis, (ii) simulation of progressive gray matter atrophy, and (iii) harmonization of in-house frontotemporal dementia scans with public datasets, Cor2Vox preserved fine-grained cortical morphology at the sub-voxel level. Notably, the proposed model exhibits inherent robustness to variations in cortical geometry and unseen dementia phenotypes without retraining, paving the way for disease progression modeling and robust data augmentation in rare neurodegenerative disorders.

