Harmonizing Medicare Claims Data with OMOP: A Validated ETL Pipeline

Area of Science:

• Health Informatics
• Data Science
• Biomedical Research

Background:

• Medicare Limited Data Set (LDS) claims are valuable for research but lack standardization.
• The Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) provides a standardized format for observational health data.
• Integrating Medicare LDS data into the OMOP CDM is crucial for large-scale health services research.

Purpose of the Study:

• To develop and validate a Python-based Extract, Transform, Load (ETL) pipeline for converting Medicare LDS claims to the OMOP CDM.
• To assess the data fidelity and completeness of the conversion process.
• To facilitate standardized healthcare data utilization for observational research.

Main Methods:

• Developed a Python ETL pipeline to map Medicare LDS tables to fifteen OMOP CDM tables.
• Utilized the OMOP Data Quality Dashboard for rigorous validation of the transformed data.
• Conducted comparative analyses to evaluate concordance between original and transformed datasets.

Main Results:

• Achieved minimal data loss during the mapping of Medicare LDS tables to OMOP CDM.
• OMOP Data Quality Dashboard validation showed a 99% pass rate across over 1,500 checks.
• Demonstrated high concordance in demographic traits and clinical conditions between datasets, despite minor unmapped codes.

Conclusions:

• The developed ETL pipeline effectively standardizes Medicare LDS data into the OMOP CDM with high fidelity.
• This scalable and reproducible approach addresses critical data integration gaps for health services research, population health, and policy analysis.
• Future work will focus on incorporating additional clinical details and advanced concept mappings for enhanced data utility.