Related Experiment Videos
Reliability of a utilization review instrument in a large field study
B M Booth1, R L Ludke, E M Fisher
1HSR&D Field Program (152/NLR) VA Medical Center, North Little Rock, AR 72114.
Summary
This study found that a utilization review instrument demonstrated good to excellent inter-rater reliability among 27 nurse abstractors. This indicates that utilization management programs can achieve consistent reviews with proper training and monitoring.
Area of Science:
- Health Services Research
- Quality Improvement in Healthcare
Background:
- Utilization management programs are crucial for assessing healthcare services.
- Ensuring the consistency of utilization review instruments is vital for program effectiveness.
- Inter-rater and intrarater reliability are key metrics for evaluating review instruments.
Purpose of the Study:
- To investigate the inter-rater reliability of a specific utilization review instrument.
- To assess the consistency of reviews conducted by multiple nurse abstractors.
- To determine the reliability of the instrument within a large-scale healthcare study.
Main Methods:
- A nationwide study involving 27 nurse abstractors from the Department of Veterans Affairs.
- Extensive training provided to all abstractors by instrument developers and practice records.
- Standardized protocol for question resolution and immediate communication of decisions.
- Three reliability assessments conducted at different stages of the study.
Main Results:
- Good to excellent inter-rater reliability was demonstrated among nurse abstractors.
- High reliability was observed when comparing nurse abstractors to a physician gold standard.
- Reliability remained consistent across multiple assessment points.
Conclusions:
- The utilization review instrument is reliable for use in utilization management programs.
- Appropriate training and monitoring are essential for achieving consistent reviews.
- Healthcare organizations can be confident in the reliability of reviews conducted with this instrument.