Related Experiment Video
Updated: Sep 4, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
A process to deduplicate individuals for regional chronic disease prevalence estimates using a distributed data
Kenneth A Scott1,2, Sara Deakyne Davies3, Rachel Zucker4
1Denver Public Health Denver Health Denver Colorado USA.
Introduction:
Learning health systems can help estimate chronic disease prevalence through distributed data networks (DDNs). Concerns remain about bias introduced to DDN prevalence estimates when individuals seeking care across systems are counted multiple times. This paper describes a process to deduplicate individuals for DDN prevalence estimates.
Methods:
We operationalized a two-step deduplication process, leveraging health information exchange (HIE)-assigned network identifiers, within the Colorado Health Observation Regional Data Service (CHORDS) DDN. We generated prevalence estimates for type 1 and type 2 diabetes among pediatric patients (0-17 years) with at least one 2017 encounter in one of two geographically-proximate DDN partners. We assessed the extent of cross-system duplication and its effect on prevalence estimates.
Results:
We identified 218 437 unique pediatric patients seen across systems during 2017, including 7628 (3.5%) seen in both. We found no measurable difference in prevalence after deduplication. The number of cases we identified differed slightly by data reconciliation strategy. Concordance of linked patients' demographic attributes varied by attribute.
Conclusions:
We implemented an HIE-dependent, extensible process that deduplicates individuals for less biased prevalence estimates in a DDN. Our null pilot findings have limited generalizability. Overlap was small and likely insufficient to influence prevalence estimates. Other factors, including the number and size of partners, the matching algorithm, and the electronic phenotype may influence the degree of deduplication bias. Additional use cases may help improve understanding of duplication bias and reveal other principles and insights. This study informed how DDNs could support learning health systems' response to public health challenges and improve regional health.
More Related Videos
11:21Methodology for Establishing a Community-Wide Life Laboratory for Capturing Unobtrusive and Continuous Remote Activity and Health Data
Published on: July 27, 2018
06:32Author Spotlight: Automated Deep Brain Stimulation for Parkinson's Disease - Exploring the Possibilities and Challenges of Home Monitoring
Published on: July 14, 2023
Related Concept Videos
Methods of Documentation VII: EMR
Principles of Disease Surveillance
Statistical Software for Data Analysis and Clinical Trials
Purpose of Health Records II
Issues And Trends In Healthcare Delivery System
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Statistical Methods for Analyzing Epidemiological Data