How should immunization rates be measured in the office setting? A study from PROS and NMA PedsNet

Area of Science:

• Pediatric Health
• Public Health Surveillance
• Healthcare Quality Improvement

Background:

• Accurate measurement of immunization rates is crucial for assessing vaccine coverage and identifying gaps in pediatric healthcare.
• Existing sampling methods for immunization data collection vary in validity and reliability, impacting quality improvement initiatives.
• A robust reference standard is needed to evaluate different sampling approaches in real-world clinical settings.

Purpose of the Study:

• To compare the validity and reliability of two distinct sampling methods—consecutive patient sampling and random medical record selection—for measuring pediatric immunization rates against a defined reference standard.
• To assess the precision and accuracy of each sampling method in reflecting actual immunization coverage within a national sample of pediatric practices.

Main Methods:

• The study employed a reference standard active method, combining data from a random record survey with telephone interviews for a subgroup of pediatric patients.
• Two sampling methods were evaluated: a consecutive method (all patients seen for any reason) and a random record method (random selection of patient charts).
• Immunization rates were calculated for each method and compared against the reference standard.

Main Results:

• The consecutive sampling method yielded immunization rates that were, on average, higher and closer to the reference standard but exhibited greater variability.
• The random record method produced lower immunization rates, further from the reference standard, yet demonstrated higher precision.
• Differences in measured immunization rates between the two methods highlight the impact of sampling strategy on data interpretation.

Conclusions:

• The consecutive method for assessing immunization rates is a potentially valuable, inexpensive, and simple tool for quality improvement in pediatric practices aiming to enhance immunization delivery.
• While the random record method offers greater precision, its rates are less reflective of the reference standard compared to the consecutive method.
• The choice of sampling method significantly influences the measured immunization rates, necessitating careful consideration for accurate quality assessment and improvement efforts in pediatric healthcare.