The profile inter-unit reliability.

Area of Science:

• Health Services Research
• Quality Improvement
• Biostatistics

Background:

• Healthcare quality is assessed using patient outcomes to identify provider performance.
• Inter-unit reliability (IUR) is a common metric, but its size does not directly correlate with a measure's usefulness for identifying extreme outcomes.
• Existing metrics may not accurately reflect a quality measure's value in profiling providers with extreme results.

Purpose of the Study:

• To propose and examine an alternative reliability measure for healthcare quality assessment.
• To develop a metric that more directly assesses a quality measure's value in identifying providers with extreme outcomes.
• To evaluate the proposed reliability measure using national dialysis data.

Main Methods:

• Developed a novel reliability metric focused on the consistency of provider profiling over repeated measurements.
• Applied the new metric to various quality measures for dialysis facilities.
• Utilized national dialysis data for empirical examination.

Main Results:

• The proposed reliability measure directly assesses the utility of quality measures for identifying extreme provider performance.
• Traditional IUR may not be the most effective indicator for identifying high- or low-performing providers.
• The new metric demonstrated its value in evaluating dialysis facility quality.

Conclusions:

• A new reliability metric offers a more direct assessment of quality measure utility for provider profiling.
• This approach improves the identification of extreme performance among healthcare providers, such as dialysis facilities.
• The findings support the use of this enhanced reliability measure in healthcare quality evaluation.