Observer variation in the assessment of scintigraphy of the thyroid gland

In order to determine observer variation in the assessment of thyroid scintigrams two specialists in nuclear medicine and two specialists in endocrinology independently evaluated 240 thyroid pertechnetate scintigrams twice, and assessed a number of variables concerning size and isotope uptake. The observed agreement between pairs of observers for the variables ranged from 0.70 to 0.98. By the use of the kappa coefficient the observed agreement was adjusted for change agreement. Kappa can variate from -1 (total disagreement) to +1 (perfect agreement). Kappa values between 0.29 and 0.86 were found. In the intraobserver study the observed agreement ranged from 0.83 to 0.99 resulting in kappa coefficients between 0.53 and 0.96. Thus the level of agreement in the present study was "fair to substantial" for agreement in the interobserver part and "substantial to almost perfect" for agreement in the intraobserver part. No difference was found in the level of agreement between the nuclear specialists and the endocrinologists. Although the treatment of patients is based on knowledge of the case histories and clinical and laboratory findings the high degree of observer variation may lead to misclassification of a number of patients with thyroid disease and subsequently a less optimal choice of treatment.