Related Experiment Video
Updated: Dec 17, 2025

Dynamic Lung Tumor Tracking for Stereotactic Ablative Body Radiation Therapy
Published on: June 7, 2015
Technical Note: Deep Learning approach for automatic detection and identification of patient positioning devices for
David H Thomas1, Leah K Schubert1, Yevgeniy Vinogradskiy1
1Department of Radiation Oncology, University of Colorado, Aurora, CO, USA.
Purpose:
Automatic detection and identification of setup devices, using a deep convolutional neural network (CNN) for real-time multiclass object detection, has the potential to reduce errors in the treatment delivery process by avoiding documentation errors.
Methods:
A database of the setup device photos from the most recent 1200 patients treated at our institution was downloaded from the record and verify (R&V) system along with the corresponding setup notes. Images were manually labeled with bounding boxes of each device. A real-time object detection CNN using the "you only look once" (YOLOv2) architecture was trained using transfer learning of a pretrained CNN (ResNet50). The CNN was trained to detect and identify 11 of the most common treatment accessories used at our institution.
Results:
Using transfer learning of a CNN for multiclass object detection, we are able to automatically detect and identify setup devices in photographs with an accuracy of 96%.
Conclusions:
Automation in radiation oncology has the potential to reduce risk. Automatic detection of setup devices is possible using a CNN and transfer learning. This work shows both the value of incident learning systems (ILS) in practice knowledge dissemination, and shows how automation of clinical processes and less reliance on manual documentation has the potential for risk reduction in radiation oncology treatments.

