Operational evaluation of the use of photographs for grading active trachoma

We evaluated the reliability of photographs to verify field diagnoses of active trachoma. We examined 956 residents of a trachoma-endemic village for signs of trachoma using the World Health Organization simplified grading system. Two photographs of the right eye of 948 persons were independently graded (masked to field assessment) by the field examiner and two other experienced graders. There was only moderate agreement between field assessment and the subsequent photographic evaluations by the three graders. When we counted ungradable photographs as disagreements, mean kappa scores for the signs trachomatous inflammation (follicular [TF]) and trachomatous inflammation (intense [TI]) were 0.44 and 0.51, respectively. There was also only fair-to-moderate agreement between the three assessments (by different examiners) of the photographs. Either the signs TF and TI themselves are not as reliable as previously believed, or photographs should be used for their diagnosis only when reliability testing demonstrates better agreement than found here.