Ranking: a reproducible semiobjective means of evaluating overall resident performance

Eleven staff radiologists evaluated resident performance by independent subjective ranking regardless of residency year. A pooled ranking correlated with a ranking obtained from the total raw score of the American College of Radiology (ACR) Inservice Examination (P less than .005). The staff pooled ranking had a Spearman rank correlation, r = .70, with resident overall performance upon the ACR Inservice Examination. The pooled ranking had a Spearman rank correlation, r = .90, with a subsequent pooled ranking obtained six months later (P less than .0001). This method of ranking accurately predicts ACR Inservice Examination performance and appears to evaluate the objectivity of the staff radiologists involved.