Observer variation in quantification of immunocytochemistry by image analysis

This paper reports the findings of a study designed to examine observer variation as a source of inaccuracy inherent in the use of computer-assisted image analysis to measure areas of stained tissue. The rat pituitary immunostained for prolactin and galanin was used as an example to estimate patterns of immunoreactivity exhibited by different cell types. Six observers, with differing experience, selected grey level threshold values on 40 fields of images of stained tissue making three repeats of each field. The 40 fields consisted of 20 serial pairs of colocalized fields, one immunostained for prolactin, the other for galanin. The 20 pairs consisted of four pairs from each of five animals. Analysis of observer variation in the selection of threshold values showed large differences in the within- and between-observer variation. Analysis of the components of variance in the estimation of the ratios of stained tissues showed that the major source of variation was the within-observer component. An additional experiment using two observers, where half of the images were compared to the original microscope images before setting threshold levels, showed that the opportunity to make a comparison did not reduce observer variation. It is suggested that any study which uses semi-automatic methods to segment regions of a digital image can benefit from an analysis of this kind so that the sources of variation can be determined to enable maximum discriminating power in future studies.