Evaluation of competence in the interpretation of chest radiographs

The purpose of this study was to determine relative rates of missed diagnoses for radiologists as a measure of competence in interpreting chest radiographs.

Cases involving differing interpretations of chest radiographs were collected from January 1994 through December 1999 by faculty (chest and nonchest radiology specialists) in an academic radiology department. A quarterly peer-review process designated cases months after the fact, and anonymously, as no miss or as class I (nondiagnosable), class II (very difficult diagnosis), class III (should be diagnosed most of time), or class IV (should almost always be diagnosed) missed diagnoses. The rates and classes of missed diagnoses were compared among chest faculty and for the nonchest radiology specialists as a group.

Chest radiologists read 184,977 studies, and nonchest radiologists read 300,684 studies. Of these, 243 missed diagnoses were classified (classes I and II, 184 cases; class III, 50; and class IV, nine). No difference was detected in the rate of class III and IV misses among chest faculty, but nonchest faculty had significantly more class III (P = .022) and class IV misses (P = .016).

Random sampling of differing interpretations can yield a relative rate of missed diagnoses for radiologists. No difference was detected in clinically important misses (ie, classes III and IV) among chest radiologists, but a statistically significantly higher rate of seemingly obvious misdiagnoses was found for nonchest specialty radiologists. Potential biases may have influenced this analysis, including disease prevalence, sampling, clinical factors, observer variability, and truth-in-diagnosis.