Related Experiment Videos
How valid is the AHRQ Patient Safety Indicator "postoperative physiologic and metabolic derangement"?
Ann M Borzecki1, Marisa Cevasco, Qi Chen
1Center for Health Quality, Outcomes and Economic Research, Bedford VAMC, Bedford, MA, Boston, MA, USA. amb@bu.edu
Background:
The Agency for Healthcare Research and Quality Patient Safety Indicator postoperative physiologic and metabolic derangement (PMD) uses ICD-9-CM codes to screen for potentially preventable acute kidney injury (AKI) requiring dialysis plus diabetes-related complications after elective surgery. Data on PMD's accuracy in identifying true events are limited. We examined the indicator's positive predictive value (PPV) in the Veterans Health Administration (VA).
Study Design:
Trained abstractors reviewed medical records of 119 PSI software-flagged PMD cases. We calculated PPVs overall and separately for renal- and diabetes-related complications. We also examined false positives to determine reasons for incorrect identification, and true positives to determine PMD-related outcomes and risk factors.
Results:
Overall 75 cases were true positives (PPV 63%, 95% CI 54% to 72%); 73 of 104 AKI cases were true positives (PPV 70%, 60% to 79%); only 2 of 15 diabetes cases were true positives (PPV 13%, 2% to 40%). Of all false positives, 70% represented nonelective admissions and 23% had the complication present on admission. Of AKI true positives, 37% died and 26% were discharged on dialysis; 55% had chronic kidney disease (≥ stage 3) present on admission. Cardiac surgery represented the largest category of AKI-associated index procedures (30%). AKI was most commonly attributed to perioperative renal hypoperfusion (84% of true positives), followed by nephrotoxins (33%) including contrast (11%).
Conclusions:
Due to its low PPV, we recommend removing diabetes complications from the indicator and focusing on AKI. PMD's PPV could be significantly improved by using present-on-admission codes, and specific to the VA, by introduction of admission status codes. Many PMD-identified cases appeared to be at high risk based on patient- and procedure-related factors. The degree to which such cases are truly preventable events requires further assessment.
Insights
The Agency for Healthcare Research and Quality
Area of Science:
- Healthcare quality and safety research.
- Patient safety indicators and outcomes.
- Nephrology and critical care medicine.
Background:
- The Agency for Healthcare Research and Quality (AHRQ) Patient Safety Indicator (PSI) postoperative physiologic and metabolic derangement (PMD) uses ICD-9-CM codes to identify acute kidney injury (AKI) and diabetes complications.
- Limited data exist on the accuracy of the PMD indicator in identifying true patient events.
- This study evaluated the positive predictive value (PPV) of the PMD indicator within the Veterans Health Administration (VA).
Purpose of the Study:
- To assess the positive predictive value (PPV) of the AHRQ PMD indicator in the VA.
- To determine the accuracy of the PMD indicator in identifying actual postoperative AKI and diabetes complications.
- To analyze reasons for false positives and outcomes of true positives to inform indicator improvement.
Main Methods:
- Medical records of 119 PSI software-flagged PMD cases were reviewed by trained abstractors.
- Positive predictive values (PPVs) were calculated overall and for renal and diabetes complications separately.
- Analysis included examination of false positives for reasons of incorrect identification and true positives for outcomes and risk factors.
Main Results:
- The overall PPV for the PMD indicator was 63%.
- The PPV for AKI was 70%, while the PPV for diabetes complications was only 13%.
- False positives often related to nonelective admissions or complications present on admission; AKI cases frequently involved chronic kidney disease or perioperative hypoperfusion.
Conclusions:
- The low PPV, particularly for diabetes complications, suggests removing these from the indicator.
- Improving the PMD indicator's PPV could involve using present-on-admission and admission status codes.
- Many identified cases were high-risk, but the preventability of these events requires further investigation.
Related Concept Videos
Peripheral Artery Disease V: Postoperative Nursing Management
Cardiomyopathy VII: Pre and Post Operative Nursing Management
Aneurysm IV: Nursing Management
Rheumatic Heart Disease IV: Nursing Management
SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
Effect of Hepatic Disease on Pharmacokinetics: Pathophysiologic Assessment and Liver Function Test