Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Assessment of Diffusion and Perfusion01:17

Assessment of Diffusion and Perfusion

Understanding and evaluating diffusion and perfusion is critical in assessing a patient's respiratory and circulatory health. These processes play key roles in maintaining the body's internal environment, ensuring that tissues receive adequate oxygen while waste products are efficiently removed.
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this principle...
Magnetic Resonance Imaging01:24

Magnetic Resonance Imaging

Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Sirtuin 1 deficiency mediates chronic kidney disease-induced inflammaging cardiovascular calcification.

Molecular biomedicine·2026
Same author

Mechanism of palytoxin-induced ferroptosis in HaCaT cells via targeting TrxR1.

Cell biology and toxicology·2026
Same author

Mechanisms ofra Tetmethylpyrazine in spinal cord injury: a narrative review.

Molecular biology reports·2026
Same author

Self-assembled anchoring shell on NiO<sub><i>x</i></sub> nanocrystals enables efficient and stable wide-bandgap perovskite solar cells.

Chemical communications (Cambridge, England)·2026
Same author

Neural stem cell extracellular vesicle-mediated delivery of astragaloside IV attenuates hypoxic-ischemic brain damage by activating the mTOR pathway.

Naunyn-Schmiedeberg's archives of pharmacology·2026
Same author

Bibliometric analysis of the association between asthma and cancer: Mechanistic insights and directions for clinical translation.

Biochimica et biophysica acta. Reviews on cancer·2026

Related Experiment Video

Updated: Jul 7, 2026

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities
07:13

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities

Published on: October 27, 2023

FreeMMIF: interactive multimodal medical image fusion via instruction-aware diffusion.

Huizhong Bai1, Gang Liu2, Bowen Deng1

  • 1The First Clinical Medical School, Beijing University of Chinese Medicine, Beijing, China.

Frontiers in Neurology
|July 6, 2026
PubMed
Summary

FreeMMIF enables adaptive multimodal medical image fusion (MMIF) using a vision-language model (VLM) and diffusion model. Physicians can now control fusion results via text instructions for enhanced clinical diagnosis.

Keywords:
diffusion modelfeature re-weightingimage fusionmedical imagevision-language model

Related Experiment Videos

Last Updated: Jul 7, 2026

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities
07:13

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities

Published on: October 27, 2023

Area of Science:

  • Medical imaging
  • Artificial intelligence in medicine
  • Computer vision

Background:

  • Multimodal medical image fusion (MMIF) integrates functional and metabolic data for improved clinical diagnosis.
  • Current MMIF methods lack flexibility and on-the-fly adjustment capabilities, hindering clinical application.
  • Existing techniques often require reference images for supervision, which are not always available.

Purpose of the Study:

  • To develop an interactive framework (FreeMMIF) for preference-adaptive MMIF.
  • To enable physicians to control fusion parameters through natural language instructions.
  • To provide robust supervision for MMIF models without relying on reference images.

Main Methods:

  • Utilized a vision-language model (VLM) for pseudo-ground truth generation and instruction-based weight control.
  • Employed an instruction-aware diffusion model with adaptive feature re-weighting for dynamic fusion.
  • Implemented prompt engineering for a VLM to translate physician instructions into fusion parameter adjustments.

Main Results:

  • FreeMMIF generates diagnostic-quality fused images that align with clinical intent.
  • The framework successfully integrates VLM-based pseudo-labeling and instruction-aware diffusion.
  • Physician control over source modality ratios was achieved through text instructions.

Conclusions:

  • FreeMMIF offers a flexible and interactive solution for multimodal medical image fusion.
  • The proposed approach enhances diagnostic reliability by adapting fusion to specific clinical needs.
  • This work advances the integration of AI, particularly VLMs and diffusion models, into clinical image analysis.