Diagnostic reproducibility of Pap testing in two regions of Mexico: the need for quality control mechanisms

To assess the reproducibility of diagnostic results obtained by examining Pap smears for cervical neoplasia, a study was conducted using a single group of 20 Pap smears, 3 negative and 17 from patients with varying degrees of neoplasia. These smears were examined by 14 volunteer readers (13 cytotechnologists and 1 cytopathologist) from the Mexican states of Oaxaca and Veracruz, and also by a highly experienced cytopathologist certified by the Mexican Board of Pathological Anatomy whose work provided a reference standard. Individual variability, as assessed by the Kappa coefficient of concordance, showed considerable difference in the diagnostic results obtained by different readers-the degree of agreement depending on the type of cervical lesion involved and the number of specimens from patients with that type of lesion. There was little diagnostic agreement when the specimens were assessed for particular classes of cervical neoplasia-mild, moderate, or severe neoplasia, carcinoma in situ, or invasive cervical cancer. (The greatest concordance was found in diagnosing specimens from subjects with invasive cervical cancer.) However, when the diagnosis was assessed continuously, using Kappa weighted in accordance with the five possible diagnoses of cervical neoplasia, the apparent reproducibility of the diagnoses improved greatly, Kappa coefficients for the 14 readers ranging from 0.31 to 0.72. In general, these data support the view that there is a need in Mexico and other parts of the Americas to establish quality control mechanisms monitoring cytologic diagnosis of cervical neoplasia, to standardize diagnostic nomenclature using a system such as the Bethesda System, to institute periodic certification, and to provide continuing training. As this suggests, it is necessary not only to evaluate but also to bring about organizational changes in order to expeditiously prevent or correct the problems that currently constrain achievement of efficient and effective cytologic diagnosis.