Variation in outcomes of quality measurement by data source

Area of Science:

• Health Services Research
• Pediatric Quality Measurement
• Health Informatics

Background:

• The Children's Health Insurance Program Reauthorization Act (CHIPRA) mandates quality measures for pediatric care.
• Accurate assessment of these quality measures is crucial for improving healthcare delivery.
• Traditional reliance on administrative claims data may limit the precision of these assessments.

Purpose of the Study:

• To evaluate the accuracy of CHIPRA quality measures using administrative claims data alone.
• To compare the performance of claims-only data with electronic health record (EHR) data.
• To determine the impact of combining claims and EHR data on quality measure accuracy.

Main Methods:

• A cohort of pediatric patients continuously enrolled in Oregon's public health insurance program during 2010 was analyzed.
• Selected CHIPRA quality measures were calculated using administrative claims data.
• The same measures were recalculated using EHR data and a combined dataset of linked claims and EHR data.
• The k statistic was used to assess agreement between claims and EHR data.

Main Results:

• Body Mass Index (BMI) percentile recording was 1.0% with claims data versus 71.9% with EHR data (k=0.01).
• For recommended immunizations in 2-year-olds, rates were 20.2% (claims), 17.2% (EHR), and 21.4% (combined data).
• Combined data generally provided more comprehensive quality measure results compared to claims or EHR data alone.

Conclusions:

• Assessing pediatric care quality solely through administrative claims data may lead to inaccurate evaluations.
• Integrating electronic health record (EHR) data with administrative claims significantly enhances the completeness and accuracy of quality measurement.
• Combined data approaches are recommended for a more robust understanding of pediatric healthcare quality.