Non-physician grader reliability in measuring morphological features of the optic nerve head in stereo digital images

To introduce a new method of grading optic nerve stereo disc photographs and evaluate reproducibility of assessments by non-physician graders in a reading center.

Three non-physician graders, experienced in grading features of the retina but not the optic nerve head (ONH), were trained by glaucoma specialists to assess digital stereo color images of the ONH. These graders assessed a total of 2554 digital stereo disc images from glaucoma cases and controls participating in the Primary Open-Angle African American Glaucoma Genetics (POAAGG) study by outlining the optic cup and disc. Inter-grader reproducibility of area, height, and width measurements was analyzed.

Among all images, the intraclass correlation (95% confidence interval) was 0.90 (0.89, 0.90) for the cup area using only color cues; 0.92 (0.91, 0.92) for the cup area using contour and vascular cues; and 0.99 (0.99, 0.99) for the optic disc area. The intraclass correlation for cup-to-disc ratio (CDR) was 0.61 (0.58, 0.63), as determined by the ratio of optic cup area to optic disc area (using contour and vascular cues). The CDR difference by graders for area was ≤ 0.1 in 65% of images using color/vascular cues and ≤0.1 in 71% of images using color cues.

After adequate training, non-physician graders were able to measure the optic nerve CDR with high inter-grader reliability.