Quantitative imaging: Erring patterns in manual delineation of PET-imaged lung lesions

Uncertainty and variability in manual contouring of PET-imaged tumor targets are well recognized; however, the error patterns associated with it were little known and rarely investigated. The present study is aimed to quantitatively assess the erring patterns inherent to manual delineation of PET-imaged lung lesions in a setting with complete ground truth.

Images being used for assessment consisted of 26 synthetic PET datasets created by using the anthropomorphic Zubal phantom in conjunction with the Monte Carlo based SimSET computational package. Each dataset included one PET-positive lesion differing in shape, dimension, uptake heterogeneity, and anatomical location inside the lung. Target contours were provided by 10 raters and the contour accuracy was evaluated using 12 metrics from five categories - spatial overlap, pair counting, information theory, distance, and volume.

In terms of spatial overlap, manual contouring results intersect substantially with the ground truth whereas tend to oversegment the lesions. Shapes of the segmented tumor volumes are in general geometrically consistent with the ground truth but lack sensitivity in characterizing topographical details. No complete consensus could be achieved between manual contours and the ground truth for any of the given lesions being examined when assessing using pair counting- and informatics-based metrics thus indicating an intrinsic stochastic component of manual contouring. Evaluation based on metrics related to distance and volume demonstrated that it is at the borderline areas between the lesions and the normal tissues where the majority part of manual delineation errors occurred and the extent of volume being identified false positively as cancerous by the raters is appreciable.

Quantification of segmentation errors associated with expert manual contouring of PET positive lesion in the lung reveals general patterns in what otherwise might be thought of as randomness. Findings from the current study may allow for the formation of new hypotheses towards improving the accuracy and precision of manual delineation of PET positive tumor targets in the lung.