Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Methods of Documentation VI: Case Management Model01:15

Methods of Documentation VI: Case Management Model

The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic illness...
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
Multicompartment Models: Overview01:14

Multicompartment Models: Overview

Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Towards Early Prediction of Amyotrophic Lateral Sclerosis Empowered by Machine Learning and Clinical Big Data.

AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science·2026
Same author

Ultrafast Hopping Transfer Enables High-Anion Conduction.

Journal of the American Chemical Society·2026
Same author

AL109933.1 inhibits hepatocellular carcinoma progression via downregulating the Warburg effect and inactivating the YY1/PKM2/PIK3R1/PI3K/AKT/ mTOR/HIF-1α axis.

Cellular signalling·2026
Same author

Predicting Intensive Care Readmission Among Hospitalized Children.

medRxiv : the preprint server for health sciences·2026
Same author

A Hybrid Language Framework for Ontology-Based Clinical Concept Extraction.

Journal of healthcare informatics research·2026
Same author

Designing High-Performance Dual-Ion Batteries at High-Voltage: Challenges, Strategies, and Prospects.

Nano-micro letters·2026
Same journal

ARKE: An ontology-driven framework for automated mapping of local radiology procedure terms to the LOINC-RadLex playbook using large language model.

Journal of biomedical informatics·2026
Same journal

A validation-driven training controller for cross-lingual biomedical NER via reinforcement learning-based adaptive loss weighting.

Journal of biomedical informatics·2026
Same journal

ASP-HR: An Adaptive Spatial Perception and Hierarchical Reasoning mechanism for document-level biomedical relation extraction.

Journal of biomedical informatics·2026
Same journal

Beyond Accuracy: Safety-Centered guidelines for the evaluation of LLM-based therapy recommendation systems for chronic multimorbidity patients.

Journal of biomedical informatics·2026
Same journal

DeepEN: A deep reinforcement learning framework for personalized enteral nutrition in critical care.

Journal of biomedical informatics·2026
Same journal

MMTF-DTI: Drug-target interaction prediction via multimodal feature extraction and dynamic fusion.

Journal of biomedical informatics·2026
See all related articles
  1. Home
  3. Explainable Multimodal Deep Learning Models For Variable-length Sequences In Critically Ill Patients.
  1. Home
  3. Explainable Multimodal Deep Learning Models For Variable-length Sequences In Critically Ill Patients.

Related Experiment Video

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
09:47

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

2.0K

Explainable multimodal deep learning models for variable-length sequences in critically ill patients.

Jennifer Martin1, Majid Afshar2, Askar Safipour Afshar1

  • 1Department of Medicine, University of Wisconsin, Madison, WI, USA.

Journal of Biomedical Informatics
|February 26, 2026

View abstract on PubMed

Summary
This summary is machine-generated.

This study introduces an explainable deep learning framework for predicting critical care events using multimodal electronic health record data. The model enhances prediction accuracy and provides crucial insights into feature importance for clinical decision-making.

Keywords:
Artificial intelligenceCritical careExplainable artificial intelligenceMachine learning

Related Experiment Videos

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
09:47

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

2.0K

Area of Science:

  • Artificial Intelligence in Medicine
  • Clinical Informatics
  • Deep Learning for Healthcare

Background:

  • Deep learning models excel at predicting clinical events using structured electronic health record (EHR) data.
  • Incorporating unstructured clinical notes enhances model accuracy but presents challenges in multimodal fusion and explainability, especially with variable-length temporal data.
  • Existing methods struggle to effectively integrate diverse data types and provide interpretable predictions for intensive care unit (ICU) trajectories.

Purpose of the Study:

  • To develop an explainable temporal modeling framework for multimodal EHR data.
  • To accommodate variable-length ICU trajectories and support diverse outcome prediction tasks.
  • To improve the accuracy and interpretability of deep learning models in critical care.

Main Methods:

  • Two multimodal recurrent neural networks (RNNs) with distinct fusion architectures (Pre-RNN and Post-RNN) were developed, integrating structured EHR variables and unstructured clinical notes at hourly timesteps.
  • Time2Vec and RNN layers with masking handled variable-length sequences, while integrated gradients were used for explainability, quantifying temporal and cross-modal feature importance.
  • Models were evaluated on predicting 24-hour mortality, seven-day discharge, and four-hour ventilator or vasopressor onset using a public EHR dataset.

Main Results:

  • Multimodal fusion models significantly outperformed unimodal baselines across all prediction tasks.
  • The Pre-RNN fusion architecture achieved the highest area under the precision-recall curve (AUPRC) for three of the four outcomes.
  • Performance gains were more substantial for intermediate and long-horizon events (≥24 hours) compared to short-horizon events.
  • Integrated gradients analysis revealed specific attribution patterns, linking physiological features and clinical concepts to patient risk.

Conclusions:

  • The developed variable-length multimodal framework enhances the performance of deep learning models in critical care.
  • The framework provides timestep-level feature importance, significantly improving the explainability and clinical relevance of predictions.
  • This approach offers a promising direction for advancing AI applications in critical care settings.