CT colonography: interpretative performance in a non-academic environment

To investigate interpretative accuracy and reporting time for radiologists performing computed tomography (CT) colonography in day-to-day non-academic clinical practice.

Thirteen radiologists from seven centres, who were reporting CT colonography in non-academic daily clinical practice, interpreted a dataset of 15 colonoscopically validated cases in a controlled environment. Ten cases had either a cancer or polyp >10mm; one case had a medium polyp and four were normal. Correct case categorization and interpretation times were compared using analysis of variance to aggregated results obtained from both experienced observers and observers recently trained using 50 cases, working in an academic environment. The effect of experience was determined using Spearman's rank correlation.

Individual accuracy was highly variable, range 53% (95% CI 27-79%) to 93% (95% CI 68-100%). Mean accuracy overall was significantly inferior to experienced radiologists (mean 75 versus 88%, p=0.04) but not significantly different from recently trained radiologists (p=0.48). Interpretation time was not significantly different to experienced readers (mean 12.4 min versus 11.7, p=0.74), but shorter than recently trained radiologists (p=0.05). There was a significant, positive, linear correlation between prior experience and accuracy (p<0.001) with no plateau.

Accuracy for sub-specialist radiologists working in a non-academic environment is, on average, equivalent to radiologists trained using 50 cases. However, there is wide variability in individual performance, which generally falls short of the average performance suggested by meta-analysis of published data. Experience improves accuracy, but alone is insufficient to determine competence.