Related Experiment Video
Updated: Aug 8, 2026

10:50
Denver Papillae Protocol for Objective Analysis of Fungiform Papillae
Published on: June 8, 2015
Identifying disagreement in ordinal ratings within a fixed panel of cytotechnologists
1Department of Epidemiology/Biomathematics, University of Texas Health Center at Tyler 75710.
Analytical and Quantitative Cytology and Histology
|December 1, 1994
Abstract:
In many clinical settings, a fixed number of raters screen specimens with more than two ordinal outcomes (for example, mild, moderate, severe). A design is proposed that facilitates the measurement of both interrater and intrarater agreement and associated trends. Design deficiencies are discussed, as are the propriety and interpretation of some common indices of reliability and reproducibility. The concepts are illustrated with data from cytopathologic ratings for sputum light microscopy.

