Related Experiment Video
Updated: Jun 28, 2026

Workflow and Framework for Collecting and Implementing Point-of-Care Ultrasound Data in the Management of Heart Failure Patients
Published on: July 12, 2024
Analysis of a failed clinical decision support system for management of congestive heart failure
Rajiv Wadhwa1, Douglas B Fridsma, Melissa I Saul
1Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, USA.
Insights
A rule-based clinical decision support system (CDSS) for congestive heart failure (CHF) core measures performed poorly, with low positive predictive value and physician alert fatigue. This highlights challenges in implementing automated clinical support systems.
Area of Science:
- Clinical Informatics
- Healthcare Quality Improvement
- Cardiology
Background:
- The Joint Commission mandates Congestive Heart Failure (CHF) Core Measures to improve patient care quality.
- Clinical Decision Support Systems (CDSS) are increasingly used to enhance adherence to clinical guidelines.
- Implementing new health information technology can present challenges in real-world clinical settings.
Purpose of the Study:
- To evaluate the performance of a newly developed rule-based CDSS designed to increase compliance with CHF Core Measures.
- To identify implementation challenges and physician interaction patterns with the CDSS.
- To assess the accuracy and utility of the CDSS in identifying patients with primary CHF.
Main Methods:
- A rule-based CDSS was developed and deployed at a community hospital.
- The CDSS performance was evaluated by comparing its identification of primary CHF patients against a manual record review.
- Key performance metrics including sensitivity and positive predictive value (PPV) were calculated. Physician alert response rates were also tracked.
Main Results:
- The CDSS demonstrated a sensitivity of 0.79 but a low positive predictive value (PPV) of 0.11.
- The system generated multiple alerts for most patients (74%), often for those without primary CHF.
- Physicians frequently did not respond to the initial alerts (63%), indicating potential alert fatigue or low perceived value.
Conclusions:
- The rule-based CDSS performed poorly in accurately identifying patients with primary CHF and faced significant implementation challenges.
- High alert volume and low PPV contributed to low physician engagement and alert non-response.
- Despite its failure, the system provided valuable insights that informed the development of a subsequent, more successful CHF management strategy.
Abstract:
In order to increase compliance with The Joint Commission's Congestive Heart Failure Core Measures, a rule based clinical decision support system (CDSS) was developed and deployed at a community hospital in our health system. We evaluated the performance of the CDSS in identifying patients with primary congestive heart failure (CHF)and identified problems encountered with its introduction. Performance of the CDSS was compared against a manual review of records of patients with diagnosis of primary CHF. The CDSS had a sensitivity of 0.79 and PPV of 0.11. The CDSS issued multiple alerts for majority of the patients(74%). The number of alerts issued for patients without primary CHF was large, and for a majority of patients (63%) physicians did not respond to alerts the first time. The CDSS performed poorly and was eventually withdrawn but provided insight into a subsequently successful method for managing CHF.
Related Concept Videos
Heart Failure V: Medical Management
Heart Failure IV: Classification and Diagnostic Evaluation
Heart Failure VII: Nursing Interventions
Cardiomyopathy II: Dilated Cardiomyopathy
Heart Failure VI: Adjunct Therapies
Pathophysiology of Heart Failure
