Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 14, 2026

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
07:31

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

Knowledge-Augmented Large Language Model for Multimodal Electronic Health Record-Based Risk Prediction: Development

Rituparna Datta1, Jiaming Cui2, Zihan Guan1

  • 1University of Virginia, Charlottesville, VA, United States.

JMIR AI
|June 12, 2026
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Graph-Based Prediction of Spatio-Temporal Vaccine Hesitancy From Insurance Claims Data.

IEEE access : practical innovations, open solutions·2025
Same author

Anti-interleukin-23 treatment linked to improved <i>Clostridioides difficile</i> infection survival.

Gut microbes·2025
Same author

Anti-Interleukin-23 Treatment Linked to Improved <i>Clostridioides difficile</i> Infection Survival.

medRxiv : the preprint server for health sciences·2024
Same author

Improving Risk Prediction of Methicillin-Resistant Staphylococcus aureus Using Machine Learning Methods With Network Features: Retrospective Development Study.

JMIR AI·2024
Same author

The Value of Outpatient Parenteral Antimicrobial Therapy: Better Care in 27 Minutes.

Clinical infectious diseases : an official publication of the Infectious Diseases Society of America·2024
Same author

Validation of clinical risk tools for recurrent <i>Clostridioides difficile</i> infection.

Infection control and hospital epidemiology·2024
Same journal

Supporting Radiology Resident Education and Clinical Decision-Making With Large Language Models: Comparative Study of Reasoning Models DeepSeek-R1 and ChatGPT-o1.

JMIR AI·2026
Same journal

Patient Perceptions on the Use of Artificial Intelligence in Creating Clinical Research Documents: Survey Study.

JMIR AI·2026
Same journal

Application of Language Models for the Analysis of Adverse Drug Events in Pharmaceutical Research and Development: Scoping Review.

JMIR AI·2026
Same journal

Correction: Deep Learning for Age Estimation and Sex Prediction Using Mandibular-Cropped Cephalometric Images: Comparative Model Development and Validation Study.

JMIR AI·2026
Same journal

AI-Assisted Systematic Literature Review of the Economic Burden of Pneumococcal Disease: Development and Validation Study.

JMIR AI·2026
Same journal

A Structured Comparison of the Coalition for Health AI Responsible AI Guide and South Korea's Trustworthy AI Guideline for Health Care AI Assurance: Comparative Framework Analysis.

JMIR AI·2026
See all related articles
This summary is machine-generated.

KAMELEON, a novel framework, improves clinical outcome prediction by integrating electronic health records and biomedical knowledge. This approach significantly enhances risk prediction accuracy, outperforming existing methods.

Area of Science:

  • Computational biology and bioinformatics
  • Machine learning in healthcare
  • Clinical informatics

Background:

  • Accurate clinical outcome prediction from electronic health records (EHRs) is vital for patient care and resource management.
  • Existing machine learning models face challenges with EHR multimodality, long clinical note contexts, and imbalanced data.
  • Integrating structured EHR data with unstructured clinical notes and external knowledge is needed for improved prediction.

Purpose of the Study:

  • To introduce and evaluate KAMELEON (Knowledge-Augmented Multimodal EHR Learning for Outcome Prediction), a hybrid framework.
  • To enhance clinical risk prediction by integrating diverse EHR modalities and external biomedical knowledge.
  • To assess KAMELEON's performance against established models and large language models (LLMs).
Keywords:
EHRbiomedical knowledge graphsclinical risk predictionelectronic health recordsknowledge-augmented reasoninglarge language modelsmachine learningmultimodal data integration

Related Experiment Videos

Last Updated: Jun 14, 2026

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
07:31

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

Main Methods:

  • Utilized the Medical Information Mart for Intensive Care-III (MIMIC-III) dataset (over 40,000 ICU patients).
  • Evaluated 30-day readmission and in-hospital mortality prediction using patient-disjoint 80:20 train-test splits.
  • Compared KAMELEON against general/medical LLMs and structured baselines using AUROC, AUPRC, and macro F1-score metrics.

Main Results:

  • KAMELEON consistently outperformed all evaluated baselines across prediction tasks.
  • The KAMELEON-balanced random forests model achieved an AUROC of 0.85 for 30-day readmission prediction.
  • The KAMELEON-extreme gradient boosting model achieved an AUROC of 0.92 and AUPRC of 0.650 for in-hospital mortality prediction.
  • LLM-generated reasoning was critical, with its removal significantly degrading performance (AUROC dropped from 0.85 to 0.7).

Conclusions:

  • KAMELEON is a pioneering framework enhancing LLMs for healthcare prediction via graph-guided knowledge retrieval and structured ML.
  • The framework demonstrates superior performance, validating the synergistic value of multimodal data and LLM reasoning.
  • KAMELEON offers a robust approach to clinical risk estimation, addressing limitations of prior predictive models.