Related Experiment Video
Updated: Jul 4, 2026

Hydra, a Computer-Based Platform for Aiding Clinicians in Cardiovascular Analysis and Diagnosis
Published on: September 26, 2018
Rheumatic Digital Twin: Proposed Machine Learning-Based Multimodal Framework to Inform Clinical Decision-Making
Daniyal Selani1,2, Rachel Knevel2, Marcel Reinders1,3
1Pattern Recognition and Bioinformatics, Faculty Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands.
We designed the Rheumatic Digital Twin to create dynamic patient models from diverse health data. This computational framework aims to improve precision medicine for rheumatic diseases by predicting clinical events and treatment responses.
Area of Science:
- Computational medicine
- Rheumatology
- Precision medicine
Background:
- Rheumatic diseases are complex and heterogeneous, making snapshot assessments insufficient for understanding their longitudinal progression.
- Current clinical approaches lack the ability to capture the dynamic nature of chronic immune-mediated conditions.
- There is a need for advanced tools to support precision medicine in rheumatology.
Purpose of the Study:
- To present the design of the Rheumatic Digital Twin, a conceptual framework for dynamic patient modeling.
- To integrate heterogeneous multimodal data for a comprehensive representation of the patient journey.
- To enable in silico cohorting for improved clinical decision-making in rheumatic diseases.
Main Methods:
- Utilizing domain-specific foundation models to process distinct data modalities (EHR, clinical notes, imaging, omics).
- Employing Transformer architectures with self-attention mechanisms to model temporal disease progression.
- Fusing unimodal representations via joint embedding techniques to create a shared multimodal space.
Main Results:
- The framework maps patients into a latent space where proximity indicates clinical and biological similarity.
- Identification of "nearest neighbors" (patients with similar trajectories) enables in silico cohorting.
- The system theoretically allows forecasting of clinical events and treatment responses.
Conclusions:
- The Rheumatic Digital Twin offers a novel approach to dynamically represent patient journeys in rheumatic diseases.
- This framework addresses data integration challenges and supports precision medicine implementation.
- It has the potential to enhance clinical forecasting, treatment prediction, and understanding of disease trajectories.
Related Concept Videos
Rheumatic Heart Disease I: Introduction
Rheumatic Heart Disease II: Clinical Manifestations and Diagnostic Studies
Rheumatic Heart Disease III: Medical Management
Rheumatic Heart Disease IV: Nursing Management