RADPEER quality assurance program: a multifacility study of interpretive disagreement rates

Area of Science:

• Radiology
• Medical Informatics
• Quality Improvement

Background:

• The American Board of Medical Specialties mandates performance evaluation for physician maintenance of certification.
• Existing peer review systems often add significant workload and lack uniformity.
• A need exists for a confidential, uniform, and efficient radiology peer review system.

Purpose of the Study:

• To develop and test the Radiology Peer Review (RADPEER) system.
• To ensure the system is confidential, uniform, and minimally burdensome.
• To provide useful data for performance evaluation in radiology practices.

Main Methods:

• Radiologists rate previous interpretations on a 4-point scale.
• Disagreements are reviewed by a practice-specific peer review committee.
• Central data entry and analysis are performed for collected ratings.
• A pilot test involving 14 facilities was conducted in 2002.

Main Results:

• Over 20,000 cases were reviewed during the pilot test.
• Average disagreement rates were 2.9% for difficult cases and 0.8% for validated misinterpretations.
• Significant variations in misinterpretation rates were observed across modalities and facilities.
• Individual radiologist misinterpretation rates varied, with 2 out of 31 exceeding expected rates.

Conclusions:

• The RADPEER system successfully engaged multiple facilities throughout the pilot.
• Generated data are valuable for individual radiologist peer review and identifying modality-specific differences.
• RADPEER is a functional solution for radiology peer review, meeting desired characteristics.