Interobserver agreement in pathologic evaluation of bile duct biopsies

Intraductal biopsy is commonly used for preoperative evaluation of the etiology of biliary strictures. Interpretation of intraductal biopsies is frequently challenging. The diagnosis often suffers from interobserver disagreement, which has not been studied in the literature. We sought to assess interobserver concordance in the interpretation of intraductal biopsies. Eighty-five biopsies were retrieved, falling into five diagnostic categories: negative for dysplasia (NED), indefinite for dysplasia (IND), low-grade dysplasia (LGD), high-grade dysplasia (HGD), and carcinoma (CA). Eight gastrointestinal pathologists blindly reviewed all the slides. Agreement among pathologists was analyzed using Fleiss κ and weighted concordance coefficient S∗. A face-to-face consensus/training session was held to discuss the classification criteria, followed by a second round review. The overall interobserver agreement was fair in the first round review (κ = 0.39; S∗ = 0.56) and improved to moderate in the second round review (κ = 0.48; S∗ = 0.69). The agreement before and after consensus meeting was substantial to nearly perfect for CA (κ = 0.65, S∗ = 0.83; and κ = 0.80, S∗ = 0.91), fair for HGD (κ = 0.28, S∗ = 0.69; and κ = 0.40, S∗ = 0.63), and moderate for NED (κ = 0.47, S∗ = 0.50; and κ = 0.47, S∗ = 0.53). Agreement improved from fair to moderate for LGD (κ = 0.36, S∗ = 0.61; and κ = 0.49, S∗ = 0.71) and slight to fair for IND (κ = 0.16, S∗ = 0.51; and κ = 0.33, S∗ = 0.50). Compared with Hollande's fixed specimens, the agreement was higher in almost all diagnostic categories in formalin-fixed biopsies. Overall, interobserver concordance was improved after a consensus/training session. Interobserver reproducibility was high at the end of the diagnostic spectrum (CA) but fair to moderate for other diagnostic categories.