Applying the "positive predictive value-recall diagram" to monitor performance and provide recommendations for screening radiologists

  • 0Dutch Expert Centre for Screening (LRCB), Nijmegen, The Netherlands. tanya.geertse@radboudumc.nl.

|

|

Summary

This summary is machine-generated.

Positive predictive value (PPV)-recall diagrams help audit teams identify variations in breast cancer screening performance. While recommendations often improved recall rates, further individual radiologist feedback may be needed for optimal results.

Area Of Science

  • Radiology and Imaging
  • Quality Assurance in Healthcare
  • Biostatistics

Background

  • Monitoring radiologist performance in breast cancer screening is crucial for optimizing detection rates and minimizing false positives.
  • Variations in performance metrics like recall rate (RR), cancer detection rate (CDR), and positive predictive value (PPV) necessitate effective quality assurance tools.
  • Existing methods may not fully capture the interrelationships between these key performance indicators across different reading units (RUs).

Purpose Of The Study

  • To evaluate the utility of positive predictive value (PPV)-recall diagrams for monitoring and guiding performance improvements in RUs within a national breast cancer screening program.
  • To assess the suitability of PPV-recall diagrams in identifying variations in screening performance over time and between different RUs.
  • To determine the impact of audit recommendations, informed by PPV-recall diagrams, on RU performance.

Main Methods

  • A retrospective analysis of triennial quality assurance audit data from the Dutch breast cancer screening program (2010-2019).
  • PPV-recall diagrams were constructed using recall rate, cancer detection rate, and PPV for initial and subsequent screenings across 12 RUs.
  • RU-specific diagrams were used to track performance variations and inform audit recommendations focused on adjusting recall rates.

Main Results

  • Significant variations in RU performance were observed, with PPVs ranging widely (4.9-23.7% for initial, 21.2-54.3% for subsequent screening).
  • Target values were less frequently met for initial screenings compared to subsequent screenings, leading to more recommendations for initial screening adjustments.
  • Recommendations to adjust recall rates often resulted in the desired directional change (17/24 instances) but did not always achieve target values.

Conclusions

  • PPV-recall diagrams provide valuable insights into performance variations and interrelationships between screening outcomes for RUs.
  • These diagrams aid audit teams in formulating targeted recommendations for improving breast cancer screening performance.
  • Feedback derived solely from PPV-recall diagrams may require supplementation with individual radiologist feedback for optimal performance enhancement.

Related Concept Videos

Receiver Operating Characteristic Plot 01:15

330

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...

Sensitivity, Specificity, and Predicted Value 01:13

651

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...

Radiological Investigation III: Pulmonary Angiogram and PET Scan 01:13

166

Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...

Radiological Investigation II: MRI and Ventilation Perfusion Scan 01:30

219

Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...

Radiological Investigation I: X-ray and CT 01:30

411

Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...