PI-RADS^AI: introducing a new human-in-the-loop AI model for prostate cancer diagnosis based on MRI

This study aims to develop and validate an artificial intelligence (AI)-aided Prostate Imaging Reporting and Data System (PI-RADS^AI) for prostate cancer (PCa) diagnosis based on MRI.

The deidentified MRI data of 1540 biopsy-naïve patients were collected from four centres. PI-RADS^AI is a two-stage, human-in-the-loop AI capable of emulating the diagnostic acumen of subspecialists for PCa on MRI. The first stage uses a UNet-Seg model to detect and segment biopsy-candidate prostate lesions, whereas the second stage leverages UNet-Seg segmentation is trained specifically with subspecialist' knowledge-guided 3D-Resnet to achieve an automatic AI-aided diagnosis for PCa.

In the independent test set, UNet-Seg identified 87.2% (628/720) of target lesions, with a Dice score of 44.9% (range, 22.8-60.2%) in segmenting lesion contours. In the ablation experiment, the model trained with the data from three centres was superior (kappa coefficient, 0.716 vs. 0.531) to that trained with single-centre data. In the internal and external tests, the triple-centre PI-RADS^AI model achieved an overall agreement of 58.4% (188/322) and 60.1% (92/153) with a referential subspecialist in scoring target lesions; when one-point margin of error was permissible, the agreement rose to 91.3% (294/322) and 97.3% (149/153), respectively. In the paired test, PI-RADS^AI outperformed 5/11 (45.5%) and matched the performance of 3/11 (27.3%) general radiologists in achieving a clinically significant PCa diagnosis (area under the curve, internal test, 0.801 vs. 0.770, p < 0.01; external test, 0.833 vs. 0.867, p = 0.309).

Our closed-loop PI-RADS^AI outperforms or matches the performance of more than 70% of general readers in the MRI assessment of PCa. This system might provide an alternative to radiologists and offer diagnostic benefits to clinical practice, especially where subspecialist expertise is unavailable.