Observer variation in histologic classification of malignant and borderline ovarian tumors

Eight hundred sixty-nine primary malignant or borderline ovarian tumors reported to the Norwegian Cancer Registry were reviewed. The histologic slides were randomly distributed to six observers and classified according to the World Health Organization classification of ovarian tumors. By rotation of slides, each tumor was successively reviewed by three observers. Each observer was given approximately 40 duplicates of slides he or she had typed before, mixed in with the slides for the third review. A contracted version of the classification with 27 entries was used in the analysis. Mean intraobserver reproducibility was 62% (kappa, 0.53), varying from 50% to 75% (kappa, 0.34 to 0.70) for the individual observers. The mean rate of agreement between two observers was 56% (kappa, 0.46), varying from 46% to 65% for the individual pairs of observers. The rate of full agreement among three observers was 41%. The most common disagreements were between different specific types of carcinoma, between undifferentiated and differentiated carcinoma, between borderline and malignant tumors, between unclassified and classified carcinoma, and between mixed and pure types of carcinoma. Very low reproducibility was obtained for mixed and unclassified carcinoma.