An observer study methodology for evaluating detection of motion abnormalities in gated myocardial perfusion SPECT

To address the task of detecting nonischemic motion abnormalities from animated displays of gated myocardial perfusion single photon emission computed tomography data, we performed an observer study to evaluate the difference in detection performance between gating to 8 and 16 frames. Images were created from the NCAT mathematical phantom with a realistic heart simulating hypokinetic motion in the left lateral wall. Realistic noise-free projection data were simulated for both normal and defective hearts to obtain 16 frames for the cardiac cycle. Poisson noise was then simulated for each frame to create 50 realizations of each heart, All datasets were processed in two ways: reconstructed as a 16-frame set, and collapsed to 8 frames and reconstructed. Ten observers viewed the cardiac images animated with a realistic real-time frame rate. Observers trained on 100 images and tested on 100 images, rating their confidence on the presence of a motion defect on a continuous scale. None of the observers showed a significant difference in performance between the two gating methods. The 95% confidence interval on the difference in areas under the ROC curve (Az8 - Az16) was -0.029-0.085. Our test did not find a significant difference in detection performance between 8-frame gating and 16-frame gating. We conclude that, for the task of detecting abnormal motion, increasing the number of gated frames from 8 to 16 offers no apparent advantage.