Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Adaptive Mechanisms in Cancer Cells02:53

Adaptive Mechanisms in Cancer Cells

5.9K
Cancer cells accumulate genetic changes at an abnormally rapid rate due to the defects in the DNA repair mechanisms. From an evolutionary perspective, such genetic instability is advantageous for cancer development. Mutant cell lines accumulate a series of beneficial mutations that contribute to their progression into cancer.
Some of the advantages that cancer cells have on normal cells include - enhanced ability to divide without terminally differentiating, induce new blood vessel formation,...
5.9K
Combination Therapies and Personalized Medicine02:50

Combination Therapies and Personalized Medicine

5.0K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
5.0K
Mouse Models of Cancer Study02:43

Mouse Models of Cancer Study

5.6K
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
5.6K
Tumor Immunotherapy01:27

Tumor Immunotherapy

642
Immunotherapy is a treatment that boosts or manipulates the immune system to fight diseases, including cancer. For instance, by stimulating an immune response through vaccinations against viruses that cause cancers, like hepatitis B virus and human papillomavirus, these diseases can be prevented. Nonetheless, some cancer cells can avoid the immune system due to their rapid mutation and division. The immune response to many cancers involves three phases: elimination, equilibrium, and escape.
642

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Evaluation of DNA encoded library and machine learning model combinations for hit discovery.

npj drug discovery·2026
Same author

Assessment of Papillary Thyroid Carcinoma by Profiling Multiple Matrix Metalloproteinase Activities Using a Machine Learning-Assisted Peptide Microarray Sensing Platform.

Analytical chemistry·2026
Same author

Impact of Warm-Air Withering Methods on Aroma Quality of White Teas from Four Tea Cultivars.

Foods (Basel, Switzerland)·2026
Same author

PANTHER Challenge Report: Cross-Domain Pancreatic Tumor Segmentation in Magnetic Resonance Imaging.

Medical image analysis·2026
Same author

Hydrogel dressings for diabetic foot ulcers: microenvironment-informed design, clinical scenario matching, and translational challenges.

Diabetes research and clinical practice·2026
Same author

Electrocatalytic Hydrogenation of Pyrazine by Cu<sub>0.95</sub>Co<sub>2.05</sub>O<sub>4</sub>: Kinetics, Mechanism, and Performance.

Chemistry, an Asian journal·2026
Same journal

Vascular RhoJ Is an Effective and Selective Target for Tumor Angiogenesis and Vascular Disruption.

Cancer cell·2026
Same journal

Intratumoral B cells under stress.

Cancer cell·2026
Same journal

Chronic stress unleashes an intratumor phage-fibroblast-B cell circuit to promote tumor growth.

Cancer cell·2026
Same journal

Molecular phenotypes and spatial archetypes: A new framework for cancer-associated fibroblasts.

Cancer cell·2026
Same journal

OpenIO: An open framework for AI-native immunotherapy.

Cancer cell·2026
Same journal

From prediction to interpretation in computational pathology.

Cancer cell·2026
See all related articles

Related Experiment Video

Updated: Aug 26, 2025

A Multimodal Imaging Framework to Advance Phenotyping of Living Label-free Breast Cancer Cells
10:37

A Multimodal Imaging Framework to Advance Phenotyping of Living Label-free Breast Cancer Cells

Published on: August 22, 2025

27

Artificial intelligence for multimodal data integration in oncology.

Jana Lipkova1, Richard J Chen2, Bowen Chen3

  • 1Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA.

Cancer Cell
|October 11, 2022
PubMed
Summary
This summary is machine-generated.

This article reviews how artificial intelligence can combine diverse patient information, such as medical images, genetic data, and health records, to improve cancer diagnosis and treatment planning. By merging these different sources, researchers can create more accurate models that better reflect a patient's overall health status. The authors discuss various computational strategies for fusing this data, methods to make these systems easier for doctors to understand, and the hurdles to using these tools in hospitals. Ultimately, this approach aims to help discover new markers for disease and better ways to personalize patient care.

Keywords:
AI in oncologydeep learningdeep learning in oncologymultimodal AImultimodal fusionmultimodal integrationcancer diagnosticsmachine learningdata fusionclinical decision support

Frequently Asked Questions

More Related Videos

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
05:30

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System

Published on: July 11, 2025

193
Microfluidic Co-Culture Models for Dissecting the Immune Response in in vitro Tumor Microenvironments
07:46

Microfluidic Co-Culture Models for Dissecting the Immune Response in in vitro Tumor Microenvironments

Published on: April 30, 2021

4.8K

Related Experiment Videos

Last Updated: Aug 26, 2025

A Multimodal Imaging Framework to Advance Phenotyping of Living Label-free Breast Cancer Cells
10:37

A Multimodal Imaging Framework to Advance Phenotyping of Living Label-free Breast Cancer Cells

Published on: August 22, 2025

27
Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
05:30

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System

Published on: July 11, 2025

193
Microfluidic Co-Culture Models for Dissecting the Immune Response in in vitro Tumor Microenvironments
07:46

Microfluidic Co-Culture Models for Dissecting the Immune Response in in vitro Tumor Microenvironments

Published on: April 30, 2021

4.8K

Area of Science:

  • Oncology outcomes research within artificial intelligence
  • Computational biology and multimodal data integration methods

Background:

No prior work has fully resolved the limitations of single-modality analysis in cancer care. Current diagnostic tools often overlook the comprehensive clinical picture provided by diverse patient information sources. This gap motivated the development of systems that synthesize varied health records. Prior research has shown that isolated data streams restrict the predictive power of computational models. That uncertainty drove interest in merging radiology, histology, and genomics into unified frameworks. It was already known that combining these inputs could enhance diagnostic precision. However, existing literature frequently fails to address how these disparate sources interact within a single architecture. This review synthesizes current strategies to overcome these persistent barriers in oncology.

Purpose Of The Study:

The aim of this review is to provide a comprehensive synopsis of artificial intelligence methods for merging diverse patient information in cancer care. This study addresses the limitations of current models that rely on isolated data streams. The authors seek to explain how integrating radiology, histology, and genomics can enhance diagnostic accuracy. This work explores strategies for discovering novel patterns that influence patient outcomes. The researchers intend to outline approaches for improving the interpretability of these complex systems. This review examines the primary challenges preventing the adoption of these tools in clinical settings. The authors discuss emerging solutions that could facilitate the implementation of multimodal frameworks. This effort provides a roadmap for future exploration into AI-driven cancer research.

The researchers propose that combining radiology, histology, and genomics allows models to capture a broader clinical context. This integration improves diagnostic robustness compared to single-modality systems, which often neglect the comprehensive patient state and limit predictive accuracy.

The authors discuss fusion strategies and association discovery techniques. These approaches allow systems to identify novel patterns across disparate data types, which is a distinct advantage over traditional methods that process information in isolation.

Interpretability is necessary because it allows clinicians to understand how models reach specific conclusions. The authors argue that transparent systems are required to bridge the gap between complex algorithmic outputs and practical medical decision-making.

Electronic health records serve as a foundational component by providing longitudinal context. While imaging and genomics offer biological snapshots, these records supply the clinical history required to validate findings across different patient populations.

The researchers measure the success of these models by their ability to explain patient outcomes or treatment resistance. This phenomenon is evaluated by identifying cross-modal biomarkers that correlate with clinical progression.

The authors propose that these models will guide future exploration studies. By uncovering new associations, researchers can identify potential therapeutic targets that were previously obscured by the limitations of single-modality analysis.

Main Methods:

Review Approach involves a systematic examination of current computational frameworks for merging diverse health information. The authors analyze various fusion techniques designed to synthesize radiology, histology, and genomic datasets. This study evaluates existing strategies for identifying complex associations across different clinical inputs. The researchers assess methodologies for enhancing the transparency of black-box algorithms in medical settings. This work surveys current literature to identify common obstacles hindering the transition of these tools into hospital environments. The authors categorize emerging solutions that address data heterogeneity and missing values. This investigation provides a structured overview of current progress in the field. The analysis focuses on how these combined approaches facilitate discovery-oriented research.

Main Results:

Key Findings From the Literature demonstrate that integrating disparate modalities significantly increases the robustness of diagnostic predictions. The authors report that these systems identify novel patterns that explain differences in patient treatment resistance. Evidence shows that combining imaging and genetic data contributes to the discovery of previously unknown biomarkers. The literature suggests that these models outperform single-modality approaches in capturing the broader clinical context. Findings indicate that interpretability techniques are essential for translating model outputs into actionable clinical insights. The review highlights that current strategies successfully address some challenges related to data fusion and association discovery. Authors note that these advancements bring artificial intelligence closer to routine medical practice. The results confirm that multimodal frameworks provide a foundation for identifying new therapeutic targets.

Conclusions:

Synthesis and Implications suggest that merging diverse data streams enhances the reliability of cancer diagnostic systems. Authors propose that these integrated frameworks bring computational tools closer to real-world clinical application. The literature indicates that discovering hidden patterns across modalities helps explain variations in patient treatment responses. Researchers claim that these models provide insights that guide the identification of novel therapeutic targets. The review highlights that improving system interpretability remains a priority for successful adoption in medical settings. Authors emphasize that addressing technical challenges is necessary for the widespread implementation of these advanced technologies. The evidence suggests that multimodal fusion offers a path toward more personalized oncology practices. This synthesis confirms that cross-modal associations are vital for advancing modern cancer research.