Blinded review of retrospectively visible unreported breast cancers: an eye-position analysis

To determine whether unreported retrospectively identified cancers on mammograms receive prolonged visual attention and can be reliably detected in a blinded review.

Four experienced mammographers performed a blinded review of a test set of 20 retrospective cases where the cancer was not detected until the next mammographic evaluation, 10 prospective cases where the cancer was initially detected, and 10 cancer-free cases. Two views were digitized and displayed on a workstation. The experiment consisted of an initial impression, during which eye position was monitored, and a final impression, during which viewers zoomed on regions of interest and localized suspicious lesions. Eye-position data were analyzed to determine whether retrospectively visible cancers attracted attention to the same degree as prospectively visible cancers. The initial impression used 1,000 msec as the eye-fixation dwell criterion for detecting a lesion.

Initially, 70% of retrospective cancers and 50% of prospective cancers did not attract prolonged visual attention. In prospective cases, detailed examination significantly improved the mean receiver operating characteristic area, from.73 to.88 (P <.01), but in retrospective cases, the mean receiver operating characteristic area barely increased, from.60 to.68, due to a high true-positive-to-false-positive ratio.

At blinded review, detection of retrospectively visible cancers was significantly inferior to that of prospective cancers. It cannot be assumed that retrospectively identified cancers are intrinsically detectable, because they do not draw prolonged visual attention during visual search for breast cancers.