Reliability of a radiological grading system for dermal backflow in lymphoscintigraphy imaging

Lymphoscintigraphy may be used for diagnosing secondary lymphedema. Dermal backflow, the presence of radiotracer in dermal lymphatics, is a key clinical feature. Although often reported as present or absent, a scale that assesses the severity of dermal backflow has been previously developed. The aim of this study was to determine the reliability of these two methods of assessment.

Sixteen experienced nuclear medicine physicians assessed the quantity of dermal backflow of 57 lymphoscintigraphy scans using a 4-point descriptive scale that was dichotomized for secondary analysis. Each scan included images from four time points for women previously diagnosed with secondary lymphedema (n = 47) and controls (n = 5); five scans were presented twice to examine intraobserver reliability. This was further investigated as 13 physicians viewed the scans again on an Apple iPad2. The physicians rated their confidence in their scoring. Readers were blinded to clinical history.

Although both the 2- and 4-point scale had moderate interobserver reliability, the reliability of the 2-point scale was slightly higher (4-point: Fleiss κ = .418, standard error [SE] = .008); 2-point: Fleiss κ = .574, SE = .013). Low interobserver reliability was found when only control subjects were considered (Fleiss κ = 0.055, SE = 0.034). Intraobserver reliability of the five repeated images varied from poor to perfect (Cohen κ = .063 to 1.00), whereas moderate to substantial intraobserver reliability (Cohen's κ = .342 to .752) was found when comparing devices. The readers were highly confident of their scores.

Overall, moderate intraobserver and interobserver reliability was found for quantifying dermal backflow with both the 2- and 4-point scale.