Related Experiment Videos
Room for "quality" improvement? Validating National Surgical Quality Improvement Program-Pediatric (NSQIP-P)
Kathryn T Anderson1, Marisa A Bartz-Kurycki1, Mary T Austin2
1McGovern Medical School, University of Texas Health Sciences Center at Houston, Department of Pediatric Surgery, Houston, TX; Center for Surgical Trials and Evidence-Based Practice (C-STEP), Houston, TX.
Introduction:
Accurate data are essential for the validity of clinical registries. This study aimed to validate NSQIP-P data, assess representativeness, and evaluate risk-adjusted predictive ability at a single institution.
Methods:
A prospective appendectomy-specific pediatric surgery research database (RD) maintained by clinical researchers was compared to the NSQIP-P data for appendectomies performed in 2016 at a tertiary children's hospital. NSQIP-P sampled data collected by trained surgical clinical reviewers (SCRs) were compared to matched RD patients. Both datasets used NSQIP-P definitions. Using χ2, datasets were compared by patient demographics, disease severity (simple vs. complicated), and outcomes.
Results:
458 appendectomies for acute appendicitis were performed in 2016, of which 250 (55%) were abstracted by SCRs and matched to RD patients. Patient demographics were similar between datasets. Disease severity (NSQIP-P:50% complicated vs RD:31% complicated) and composite morbidity (NSQIP-P:6.0% vs RD:14.4%) were significantly different (both p < 0.01). Demographics and outcomes were similar between matched (n = 250) and unsampled patients in the RD (n = 208). NSQIP-P's risk-adjusted predicted morbidity was significantly lower than morbidity observed in all (n = 458) RD patients (NSQIP-P:9.9% vs RD:14.2%, p < 0.01).
Conclusions:
Though constituting a representative sample, NSQIP-P appendectomy data were inconsistent with department data. Discrepancies appear to be the result of underreporting of outcome variables and disease misclassification.
Type Of Study:
Retrospective comparative review.
Level Of Evidence:
Level III.