Evaluation of human panelists in assessing coronary atherosclerosis

The Cholesterol Lowering Atherosclerosis Study, a randomized, angiographic clinical trial, has demonstrated the beneficial effect of niacin/colestipol therapy on coronary and femoral atherosclerosis. The primary outcome was a panel-determined consensus score evaluating global coronary changes determined angiographically at 2 years. This article presents an evaluation of interreader agreement in independently assessing the status of native coronary arteries and overall coronary condition. Parameters include 1) identification of the presence of lesions and lesion changes; 2) estimation of lesion severity (percent stenosis) and amount of change in lesion severity; and 3) global assessment of change in coronary status. Readers independently agreed on 1) presence of lesions (82%) and change in lesions (51%); 2) percent stenosis +/- 10% (76%) and change in stenosis +/- 10% (81%); and 3) global assessment of change in coronary status within one step (96%). Results of these analyses may be useful in effectively designing angiographic trials that use a panel of human evaluators as well as computerized methods for angiographic interpretation.