Analysis of a failed clinical decision support system for management of congestive heart failure

Rajiv Wadhwa1, Douglas B Fridsma, Melissa I Saul

  • 1Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, USA.

Insights

A rule-based clinical decision support system (CDSS) for congestive heart failure (CHF) core measures performed poorly, with low positive predictive value and physician alert fatigue. This highlights challenges in implementing automated clinical support systems.

Area of Science:

  • Clinical Informatics
  • Healthcare Quality Improvement
  • Cardiology

Background:

  • The Joint Commission mandates Congestive Heart Failure (CHF) Core Measures to improve patient care quality.
  • Clinical Decision Support Systems (CDSS) are increasingly used to enhance adherence to clinical guidelines.
  • Implementing new health information technology can present challenges in real-world clinical settings.

Purpose of the Study:

  • To evaluate the performance of a newly developed rule-based CDSS designed to increase compliance with CHF Core Measures.
  • To identify implementation challenges and physician interaction patterns with the CDSS.
  • To assess the accuracy and utility of the CDSS in identifying patients with primary CHF.

Main Methods:

  • A rule-based CDSS was developed and deployed at a community hospital.
  • The CDSS performance was evaluated by comparing its identification of primary CHF patients against a manual record review.
  • Key performance metrics including sensitivity and positive predictive value (PPV) were calculated. Physician alert response rates were also tracked.

Main Results:

  • The CDSS demonstrated a sensitivity of 0.79 but a low positive predictive value (PPV) of 0.11.
  • The system generated multiple alerts for most patients (74%), often for those without primary CHF.
  • Physicians frequently did not respond to the initial alerts (63%), indicating potential alert fatigue or low perceived value.

Conclusions:

  • The rule-based CDSS performed poorly in accurately identifying patients with primary CHF and faced significant implementation challenges.
  • High alert volume and low PPV contributed to low physician engagement and alert non-response.
  • Despite its failure, the system provided valuable insights that informed the development of a subsequent, more successful CHF management strategy.

Related Concept Videos

Heart Failure V: Medical Management01:30

Heart Failure V: Medical Management

Medical Management of Acute Decompensated Heart Failure (ADHF)The primary goals of therapy for patients hospitalized with acute decompensated heart failure (ADHF) include:Relieving symptomsOptimizing volume statusSupporting oxygenation and ventilationMaintaining cardiac output (CO) and end-organ perfusionIdentifying and addressing the cause of ADHFPreventing complicationsProviding patient education on factors precipitating HF exacerbationPlanning for dischargeOngoing monitoring and assessment...
Heart Failure IV: Classification and Diagnostic Evaluation01:30

Heart Failure IV: Classification and Diagnostic Evaluation

Heart failure can be classified in various ways, with the most common classifications based on physical activity limitations, disease progression, severity, and treatment strategies.The Functional Classification of Heart Failure divides patients into four categories based on physical activity limitation due to symptom burden.Class I: Patients in this class have cardiac disease but no physical activity limitations. Ordinary activities like walking, climbing stairs, or routine tasks do not cause...
Heart Failure VII: Nursing Interventions01:30

Heart Failure VII: Nursing Interventions

The first step in nursing management of a patient with heart failure involves thoroughly assessing the patient's medical history.Subjective Data: Obtain the patient's medical history of coronary artery disease, hypertension, myocardial infarction, and symptoms like dyspnea, orthopnea, and paroxysmal nocturnal dyspnea.Objective Data: Conduct a physical examination to identify findings such as jugular vein distention, pulmonary crackles, tachycardia, murmurs, peripheral edema, and vital signs,...
Cardiomyopathy II: Dilated Cardiomyopathy01:30

Cardiomyopathy II: Dilated Cardiomyopathy

Dilated cardiomyopathy, or DCM, is a progressive myocardial disorder characterized by ventricular chamber dilation and contractile dysfunction.EtiologyVarious factors can cause DCM, including hypertension and heavy alcohol intake, which contribute to the weakening and enlargement of the heart muscle. Viral infections, such as Coxsackievirus B, adenoviruses, and influenza, can lead to DCM by causing inflammation and damage to heart tissue. Certain chemotherapeutic agents, including daunorubicin,...
Heart Failure VI: Adjunct Therapies01:22

Heart Failure VI: Adjunct Therapies

Additional therapies for treating patients with heart failure (HF) may include procedural interventions, supplemental oxygen, the management of sleep disorders, and nutritional therapy.Procedural InterventionsImplantable Cardioverter-Defibrillator: For patients at risk of life-threatening arrhythmias due to severe left ventricular dysfunction, an Implantable Cardioverter-Defibrillator (ICD) can detect and terminate these arrhythmias, preventing sudden cardiac death and improving survival rates.
Pathophysiology of Heart Failure01:17

Pathophysiology of Heart Failure

Heart failure (HF) is a progressive syndrome involving ventricles that leads to inadequate cardiac output. It can be classified based on location and output or ejection fraction. Ejection fraction (EF) is an essential measurement in the diagnosis and surveillance of HF. Reduced EF corresponds to systolic heart failure (HFrEF). However, HF with preserved ejection fraction (HFpEF) is becoming increasingly prevalent. Also known as diastolic HF, this form of HF is related to aging. The...