Related Experiment Video
Updated: Aug 15, 2025
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
Published on: August 30, 2013
Artificial Intelligence for Indication of Invasive Assessment of Calcifications in Mammography Screening
Stefanie Weigel1, Anne-Kathrin Brehl2, Walter Heindel1
1Clinic for Radiology and Reference Center for Mammography, University Hospital and University of Münster, Münster, Germany.
Purpose:
Lesion-related evaluation of the diagnostic performance of an individual artificial intelligence (AI) system to assess mamographically detected and histologically proven calcifications.
Materials And Methods:
This retrospective study included 634 women of one screening unit (July 2012 - June 2018) who completed the invasive assessment of calcifications. For each leasion, the AI-system calculated a score between 0 and 98. Lesions scored > 0 were classified as AI-positive. The performance of the system was evaluated based on its positive predictive value of invasive assessment (PPV3), the false-negative rate and the true-negative rate.
Results:
The PPV3 increased across the categories (readers: 4a: 21.2 %, 4b: 57.7 %, 5: 100 %, overall 30.3 %; AI: 4a: 20.8 %, 4b: 57.8 %, 5: 100 %, overall: 30.7 %). The AI system yielded a false-negative rate of 7.2 % (95 %-CI: 4.3 %: 11.4 %) and a true-negative rate of 9.1 % (95 %-CI: 6.6 %; 11.9 %). These rates were highest in category 4a, 12.5 % and 10.4 % retrospectively. The lowest median AI score was observed for benign lesions (61, interquartile range (IQR): 45-74). Invasive cancers yielded the highest median AI score (81, IQR: 64-86). Median AI scores for ductal carcinoma in situ were: 74 (IQR: 63-84) for low grade, 70 (IQR: 52-79) for intermediate grade and 74 (IQR: 66-83) for high grade.
Conclusion:
At the lowest threshold, the AI system yielded calcification-related PPV3 values that increased across categories, similar as seen in human evaluation. The strongest loss in AI-based breast cancer detection was observed for invasively assessed calcifications with the lowest suspicion of malignancy, yet with a comparable decrease in the false-positive rate. An AI-score based stratification of malignant lesions could not be determined.
Key Points:
· The AI-based PPV3 for calcifications is comparable to human assessment.. · AI showed a lower detection performance of screen-positive and screen-negative lesions in category 4a.. · Histological subgroups could not be discriminated by AI scores..
Citation Format:
· Weigel S, Brehl AK, Heindel W et al. Artificial Intelligence for Indication of Invasive Assessment of Calcifications in Mammography Screening. Fortschr Röntgenstr 2023; 195: 38 - 46.
