Related Experiment Video
Updated: Oct 11, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Comparing reliability of ICD-10-based COVID-19 comorbidity data to manual chart review, a retrospective
Joseph W Schaefer1, Joshua M Riley1, Michael Li2
1Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania, USA.
Insights
International Statistical Classification of Disease and Related Health Problems, 10th Revision (ICD-10) codes for COVID-19 comorbidities vary in accuracy. Discharge billing diagnoses offer the highest sensitivity, but all methods require careful data source selection and validation.
Area of Science:
- Medical Informatics
- Health Services Research
- Epidemiology
Background:
- Characterizing comorbidities in patient cohorts is crucial for research.
- International Statistical Classification of Disease and Related Health Problems, 10th Revision (ICD-10) codes are widely used for this purpose.
- Standardized methods for extracting ICD-10-based comorbidity data are lacking in recent literature.
Purpose of the Study:
- To compare comorbidity data derived from manual chart review versus ICD-10 codes in COVID-19 cohorts.
- To evaluate the accuracy of different ICD-10 code extraction methods.
- To assess the temporal accuracy of ICD-10 codes relative to critical clinical time points like admission.
Main Methods:
- Retrospective cross-sectional study design.
- Performance characteristics of ICD-10-based data were compared against manual chart review.
- Sensitivity analysis was conducted for various data sources and time points.
Main Results:
- Discharge billing diagnoses demonstrated the highest sensitivity (0.82) for comorbidity identification.
- The past medical history table showed a sensitivity of 0.72.
- The active problem list had a sensitivity of 0.67, which decreased significantly on the day of admission (0.58).
Conclusions:
- The accuracy of ICD-10-based comorbidity data is variable, influenced by the specific comorbidity, data source, and retrieval timing.
- Opportunities exist to improve the performance of ICD-10 code extraction.
- Future research must clearly define comorbidity data sources and validate them against manual chart reviews.
Abstract:
International Statistical Classification of Disease and Related Health Problems, 10th Revision codes (ICD-10) are used to characterize cohort comorbidities. Recent literature does not demonstrate standardized extraction methods.
Objective:
Compare COVID-19 cohort manual-chart-review and ICD-10-based comorbidity data; characterize the accuracy of different methods of extracting ICD-10-code-based comorbidity, including the temporal accuracy with respect to critical time points such as day of admission.
Design:
Retrospective cross-sectional study.
Measurements:
ICD-10-based-data performance characteristics relative to manual-chart-review.
Results:
Discharge billing diagnoses had a sensitivity of 0.82 (95% confidence interval [CI]: 0.79-0.85; comorbidity range: 0.35-0.96). The past medical history table had a sensitivity of 0.72 (95% CI: 0.69-0.76; range: 0.44-0.87). The active problem list had a sensitivity of 0.67 (95% CI: 0.63-0.71; range: 0.47-0.71). On day of admission, the active problem list had a sensitivity of 0.58 (95% CI: 0.54-0.63; range: 0.30-0.68)and past medical history table had a sensitivity of 0.48 (95% CI: 0.43-0.53; range: 0.30-0.56).
Conclusions And Relevance:
ICD-10-based comorbidity data performance varies depending on comorbidity, data source, and time of retrieval; there are notable opportunities for improvement. Future researchers should clearly outline comorbidity data source and validate against manual-chart-review.
More Related Videos
10:46A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data
Published on: December 9, 2015
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Related Concept Videos
Bias in Epidemiological Studies
Comparing the Survival Analysis of Two or More Groups
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Statistical Methods for Analyzing Epidemiological Data
Pareto Chart
The Pareto chart is named after the Italian economist Vilfredo Pareto, who described the Pareto...
Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies
Medical History