Related Experiment Video
Updated: May 23, 2025

Swabbing the Urban Environment - A Pipeline for Sampling and Detection of SARS-CoV-2 From Environmental Reservoirs
Published on: April 9, 2021
Estimating the Number of Primary vs Incidental COVID-19 Hospitalizations in Santa Clara County
Rosamond Smith1, Alexis D'Agostino1, Pamela Stoddard1
1County of Santa Clara Public Health Department, San Jose, California, USA.
Insights
International Classification of Diseases, 10th Revision (ICD-10) discharge data can accurately differentiate primary COVID-19 hospitalizations. Machine learning models enhance surveillance for local public health departments, reducing manual effort.
Area of Science:
- Public Health Surveillance
- Health Informatics
- Machine Learning in Healthcare
Background:
- Accurate monitoring of COVID-19 trends is crucial for public health.
- Differentiating primary COVID-19 hospitalizations from incidental cases is challenging using standard discharge data.
- Local health departments require efficient surveillance tools to manage public health crises.
Purpose of the Study:
- To evaluate the efficacy of International Classification of Diseases, 10th Revision (ICD-10) discharge data in distinguishing primary COVID-19 hospitalizations.
- To explore the application of machine learning algorithms for improving COVID-19 surveillance capabilities within a local public health setting.
Main Methods:
- Utilized discharge data from 5122 Santa Clara County hospitalizations with confirmed SARS-CoV-2.
- Trained multiple machine learning models to classify primary COVID-19 hospitalizations against a chart review gold standard.
- Employed Area Under the Receiver Operating Characteristic Curve (AUROC) to evaluate model performance.
Main Results:
- All trained models demonstrated strong performance, with AUROC values ranging from 0.808 to 0.818.
- Least Absolute Shrinkage and Selection Operator (LASSO) logistic regression was selected for implementation due to comparable performance, transparency, and familiarity.
- The chosen model successfully differentiated primary COVID-19 hospitalizations.
Conclusions:
- International Classification of Diseases, 10th Revision (ICD-10) discharge data can be effectively used for monitoring primary COVID-19 hospitalizations.
- Predictive algorithms offer a low-burden solution for local health jurisdictions to meet surveillance needs.
- This approach minimizes manual effort in public health surveillance, enhancing efficiency.
Background:
The goal of this study was to evaluate whether International Classification of Diseases, 10th Revision (ICD-10), discharge data can be used to accurately differentiate primary coronavirus disease 2019 (COVID-19) hospitalizations, which are specifically due to COVID-19, from incidental COVID-19 hospitalizations for monitoring COVID-19 trends in a large county health department. We sought to explore the use of machine learning algorithms for enhancing surveillance capabilities in a local public health setting.
Methods:
Discharge data for 5122 Santa Clara County hospitalizations with a positive severe acute respiratory syndrome coronavirus 2 polymerase chain reaction or antigen test occurring between December 15, 2021, and August 15, 2022, were used to train a series of models for classifying primary COVID-19 hospitalizations using chart review as a gold standard. Area under the receiver operating characteristic curve (AUROC) was used as the evaluation metric.
Results:
Each model performed well when trained on the full set of available predictors. AUROC values ranged from 0.808 (random forest) to 0.818 (SuperLearner). After evaluating each model, we implemented a reporting process based on Least Absolute Shrinkage and Selection Operator (LASSO) logistic regression, as the performance was comparable with SuperLearner and it had the advantage of being transparent and familiar to health department staff.
Conclusions:
In Santa Clara County, ICD-10 discharge data were successfully used to develop a low-burden method for monitoring primary COVID-19 hospitalization, demonstrating one way that predictive algorithms can help local health jurisdictions meet surveillance needs while minimizing manual effort.
Related Concept Videos
Steps in Outbreak Investigation
Prevalence and Incidence
Prevalence indicates the proportion of individuals in a population who have a specific disease or health...

