Related Experiment Video
Updated: Jun 4, 2025
Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
External Validation of the Neiman Imaging Comorbidity Index in Medicare, Medicaid, and Private Payer Claims Data
Casey E Pelzl1, Alexandra Drake1, Andrew B Rosenkrantz2
1The Harvey L. Neiman Health Policy Institute, Reston, Virginia.
Objective:
The Neiman Imaging Comorbidity Index (NICI) was developed and validated in a claims dataset encompassing >10 million privately insured beneficiaries, in which it outperformed the commonly used Charlson Comorbidity Index (CCI) in predicting advanced imaging use. This external validation assessed the broader generalizability of NICI for predicting receipt of advanced imaging in nationally representative populations, including patients insured by Medicare, Medicaid, and private payers.
Methods:
All 2018 to 2019 patient-level claims from the CMS Medicare 5% Research Identifiable File, CMS Medicaid 100% Research Identifiable File, and private insurance (commercial and Medicare Advantage) claims from Inovalon Insights, LLC, were included. Using 2018 comorbidity data, beneficiaries were assigned CCI and NICI. Area under the receiver operator characteristic curves (AUCs) measured index performance predicting advanced imaging in 2019. AUCs for NICI and CCI were compared overall, across age groups, and after adjusting for age and sex.
Results:
A total of 108,846,549 beneficiaries were included across Medicare (n = 2,536,403), Medicaid (n = 49,685,052), and private insurance (n = 56,625,094) datasets. NICI outperformed CCI in Medicare (AUC: 0.7709, 95 confidence interval [CI]: 0.7702-0.7716 versus AUC: 0.7503, 95% CI: 0.7496-0.7510; P < .001), Medicaid (AUC: 0.6876, 95% CI: 0.6874-0.6878 versus AUC: 0.6798 95% CI: 0.6796-0.6800]; P < .001), and private insurance data (AUC: 0.6658, 95% CI: 0.6656-0.6660 versus AUC: 0.6479, 95% CI: 0.6477-0.6481; P < .001). NICI outperformed CCI in adjusted models and in nearly all age strata across the three cohorts.
Discussion:
The NICI outperformed CCI in predicting advanced imaging in populations insured by numerous different payers. Validation data support NICI as the preferred index to adjust for patient comorbidities when studying advanced imaging as an outcome, but further investigations are warranted.
