Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Improving Models to Predict Care Utilization Using Machine Learning: Retrospective Observational Study.

Christopher Kitchen1, Talan Zhang1, Klaus Lemke1

  • 1Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, 2024 E Monument Street, Baltimore, MD, United States, 1 3015310011.

JMIR Formative Research
|June 26, 2026
PubMed
Summary

Related Concept Videos

Methods of Documentation VI: Case Management Model01:15

Methods of Documentation VI: Case Management Model

The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic illness...
Observational Studies01:11

Observational Studies

Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Clinical and Radiographic Outcomes at a Mean of 7 Years Following Primary Transfibular Total Ankle Arthroplasty in Younger and Older Patients.

The Journal of bone and joint surgery. American volume·2026
Same author

Conceptualization and development of the Maryland suicide data warehouse to improve mortality prediction.

JAMIA open·2026
Same author

Measuring the Impact of AI on Report-Drafting Efficiency in Chest Computed Tomography Interpretation: Retrospective Analysis.

Journal of medical Internet research·2026
Same author

Synergy of diagnosis coding between administrative claims and electronic health records of large patient populations across multiple healthcare organizations.

JAMIA open·2026
Same author

Assessing the impact of racial and ethnic disparities on 30-day emergency department visits after hysterectomy: A state-based retrospective cohort study.

International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics·2026
Same author

Assessing Usefulness of the Dashboard Instrument to Review Equity (DIRE) Checklist to Evaluate Equity in Public Health Dashboards: Reliability Study.

JMIR public health and surveillance·2025
Same journal

Improving Semantic Interoperability in Health Care Through Translation and Contextualization of International Organization for Standardization 13940 (ContSys) in Estonia: Qualitative Document- and Artifact-Based Study.

JMIR formative research·2026
Same journal

Framework for Health-Promoting Environments for Office Workers: Photovoice Study.

JMIR formative research·2026
Same journal

Remote Assessment of Parkinson Disease Using Deep Learning on Structured Mouse-Trace Data From Suspected Cases: Machine-Learning Pilot Feasibility Study.

JMIR formative research·2026
Same journal

Perspectives on Continuous Glucose Monitoring Among Adults with Type 2 Diabetes in the United Kingdom: Cross-Sectional Survey.

JMIR formative research·2026
Same journal

Real-World Engagement With a Generative AI Conversational Agent for Mental Health Support: Retrospective Descriptive Study.

JMIR formative research·2026
Same journal

Implementing a Commercial AI Fracture Detection Tool in Health Care Using the Non-Adoption, Abandonment, Scale-Up, Spread, and Sustainability Framework: A Formative Evaluation Study.

JMIR formative research·2026
See all related articles
This summary is machine-generated.

This study compared machine learning (ML) models against traditional logistic regression for health care risk prediction. While ML models showed slight improvements, logistic regression remains a strong choice for efficiency and interpretability in clinical settings.

Area of Science:

  • Health Informatics
  • Machine Learning in Healthcare
  • Clinical Risk Prediction

Background:

  • Artificial intelligence (AI) and machine learning (ML) are increasingly used in healthcare for risk estimation.
  • Legacy systems like the Johns Hopkins Adjusted Clinical Group (ACG) System, developed over years of clinical expertise, are now being evaluated with novel statistical approaches.
  • The ACG System is a widely adopted method for categorizing clinical risk factors and is suitable for ML techniques.

Purpose of the Study:

  • To evaluate the performance of the ACG System using machine learning algorithms.
  • To compare ML model performance against traditional logistic regression using AUROC and F1 optimization strategies.
  • To assess the potential for integrating ML into ACG-related clinical workflows.

Main Methods:

Keywords:
clinical decision supportmachine learningmedical informaticspublic health informaticsrisk stratification

Related Experiment Videos

  • A retrospective observational study was conducted using 2019 data from 350,463 patients at the Johns Hopkins Health System.
  • XGBoost, random forest, and elastic net models were tuned using cross-validation to optimize AUROC and F1 scores for predicting hospitalization and total cost.
  • Performance was compared against logistic regression, with detailed analysis of sensitivity, positive predictive value, and F-beta statistics.

Main Results:

  • XGBoost demonstrated statistically significant, though small, improvements in cross-validated AUROC and F1-scores compared to logistic regression.
  • Logistic regression achieved average AUROC values of 0.886 (cost) and 0.841 (hospitalization), while XGBoost achieved 0.891 and 0.849, respectively.
  • For F1 optimization, XGBoost exceeded logistic regression for cost (0.411 vs. 0.367) but not for hospitalization (0.328 vs. 0.341).

Conclusions:

  • Logistic regression is highly effective for clinical risk prediction tasks, particularly when model efficiency and interpretability are paramount.
  • ML models offer diverse performance trade-offs, making them suitable for specific clinical use cases.
  • Healthcare systems must align model selection and calibration with specific needs and expectations to ensure optimal performance and utility.