Utility of multimodal longitudinal imaging data for dynamic prediction of cardiovascular and renal disease: the...

Medical examinations contain repeatedly measured data from multiple visits, including imaging variables collected from different modalities. However, the utility of such data for the prediction of time-to-event is unknown, and only a fraction of the data is typically used for risk prediction. We hypothesized that multimodal longitudinal imaging data could improve dynamic disease prognosis of cardiovascular and renal disease (CVRD).

In a multi-centered cohort of 5,114 CARDIA participants, we included 166 longitudinal imaging variables from five imaging modalities: Echocardiography (Echo), Cardiac and Abdominal Computed Tomography (CT), Dual-Energy x-ray Absorptiometry (DEXA), Brain Magnetic Resonance Imaging (MRI) collected from young adulthood to mid-life over 30 years (1985-2016) to perform dynamic survival analysis of CVRD events using machine learning dynamic survival analysis (Dynamic-DeepHit, LTRCforest, and Extended Cox for Time-varying Covariates). Risk probabilities were continuously updated as new data were collected. Model performance was assessed using integrated AUC and C-index and compared to traditional risk factors.

Longitudinal imaging data, even when being irregularly collected with high missing rates, improved CVRD dynamic prediction (0.03 in integrated AUC, up to 0.05 in C-index compared to traditional risk factors; best model's C-index = 0.80-0.83 up to 20 years from baseline) from young adulthood followed up to midlife. Among imaging variables, Echo and CT variables contributed significantly to improved risk estimation. Echo measured in early adulthood predicted midlife CVRD risks almost as well as Echo measured 10-15 years later (0.01 C-index difference). The most recent CT exam provided the most accurate prediction for short-term risk estimation. Brain MRI markers provided additional information from cardiac Echo and CT variables that led to a slightly improved prediction.

Longitudinal multimodal imaging data readily collected from follow-up exams can improve CVRD dynamic prediction. Echocardiography measured early can provide a good long-term risk estimation, while CT/calcium scoring variables carry atherosclerotic signatures that benefit more immediate risk assessment starting in middle-age.