Interobserver variability in assessing adequacy of the squamous component in conventional cervicovaginal smears

We compared the interobserver reproducibility of estimating the adequacy of the squamous component of conventional Papanicolaou (Pap) smears using traditional and newly proposed criteria. Forty conventional Pap smears with varying degrees of squamous cellularity were reviewed by 13 observers who evaluated adequacy (satisfactory vs unsatisfactory) based on the traditional criterion of estimating 10% slide coverage. After being introduced to the new criterion and the reference images, the observers reevaluated adequacy on the same set of smears, using the new criterion and the reference images. With the original criterion of 10% slide coverage, 15 smears had a unanimous designation; the overall kappa value was 0.49 (P < .001). With the newly proposed adequacy criterion and reference images, 17 smears had a unanimous designation; the overall kappa value was 0.60 (P < .001). The difference in the kappa correlation coefficients was statistically significant (P = .007). While traditional and newly proposed criteria resulted in fair interobserver agreement, it seemed that the newly proposed criterion, along with the use of reference images, for evaluating adequacy of the squamous component of conventional Pap smears results in better interobserver reproducibility.