Comparing reliability of ICD-10-based COVID-19 comorbidity data to manual chart review, a retrospective

Joseph W Schaefer1, Joshua M Riley1, Michael Li2

  • 1Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania, USA.

Insights

International Statistical Classification of Disease and Related Health Problems, 10th Revision (ICD-10) codes for COVID-19 comorbidities vary in accuracy. Discharge billing diagnoses offer the highest sensitivity, but all methods require careful data source selection and validation.

Area of Science:

  • Medical Informatics
  • Health Services Research
  • Epidemiology

Background:

  • Characterizing comorbidities in patient cohorts is crucial for research.
  • International Statistical Classification of Disease and Related Health Problems, 10th Revision (ICD-10) codes are widely used for this purpose.
  • Standardized methods for extracting ICD-10-based comorbidity data are lacking in recent literature.

Purpose of the Study:

  • To compare comorbidity data derived from manual chart review versus ICD-10 codes in COVID-19 cohorts.
  • To evaluate the accuracy of different ICD-10 code extraction methods.
  • To assess the temporal accuracy of ICD-10 codes relative to critical clinical time points like admission.

Main Methods:

  • Retrospective cross-sectional study design.
  • Performance characteristics of ICD-10-based data were compared against manual chart review.
  • Sensitivity analysis was conducted for various data sources and time points.

Main Results:

  • Discharge billing diagnoses demonstrated the highest sensitivity (0.82) for comorbidity identification.
  • The past medical history table showed a sensitivity of 0.72.
  • The active problem list had a sensitivity of 0.67, which decreased significantly on the day of admission (0.58).

Conclusions:

  • The accuracy of ICD-10-based comorbidity data is variable, influenced by the specific comorbidity, data source, and retrieval timing.
  • Opportunities exist to improve the performance of ICD-10 code extraction.
  • Future research must clearly define comorbidity data sources and validate them against manual chart reviews.

Related Concept Videos

Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:  
776
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
339
Study Designs in Epidemiology01:20

Study Designs in Epidemiology

Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
489
Statistical Methods for Analyzing Epidemiological Data01:25

Statistical Methods for Analyzing Epidemiological Data

Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
600
Pareto Chart00:52

Pareto Chart

A Pareto chart is a bar graph or a combination of both line and bar graphs. The bar lengths represent the individual values or the frequency, while the lines represent the cumulative total values. In this chart, the longest bars are arranged on the left and the shortest bars on the right, which makes it easier to read and interpret the data. It can also be called a Pareto diagram or Pareto analysis.
The Pareto chart is named after the Italian economist Vilfredo Pareto, who described the Pareto...
7.3K
Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies01:27

Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies

Assessing and diagnosing Chronic Obstructive Pulmonary Disease (COPD) involves a detailed approach that includes a comprehensive review of medical history, physical examination, and a variety of diagnostic tests. This thorough evaluation is essential to ensure an accurate diagnosis and guide effective management strategies.
Medical History
2.6K