Assessment of the Sun Nuclear ArcCHECK to detect errors in 6MV FFF VMAT delivery of brain SABR using ROC analysis

Institutions use a range of different detector systems for patient-specific quality assurance (QA) measurements conducted to assure that the dose delivered by a patient's radiotherapy treatment plan matches the calculated dose distribution. However, the ability of different detectors to detect errors from different sources is often unreported. This study contains a systematic evaluation of Sun Nuclear's ArcCHECK in terms of the detectability of potential machine-related treatment errors. The five investigated sources of error were multileaf collimator (MLC) leaf positions, gantry angle, collimator angle, jaw positions, and dose output. The study encompassed the clinical treatment plans of 29 brain cancer patients who received stereotactic ablative radiotherapy (SABR). Six error magnitudes were investigated per source of error. In addition, the Eclipse AAA beam model dosimetric leaf gap (DLG) parameter was varied with four error magnitudes. Error detectability was determined based on the area under the receiver operating characteristic (ROC) curve (AUC). Detectability of DLG errors was good or excellent (AUC >0.8) at an error magnitude of at least ±0.4 mm, while MLC leaf position and gantry angle errors reached good or excellent detectability at error magnitudes of at least 1.0 mm and 0.6°, respectively. Ideal thresholds, that is, gamma passing rates, to maximize sensitivity and specificity ranged from 79.1% to 98.7%. The detectability of collimator angle, jaw position, and dose output errors was poor for all investigated error magnitudes, with an AUC between 0.5 and 0.6. The ArcCHECK device's ability to detect errors from treatment machine-related sources was evaluated, and ideal gamma passing rate thresholds were determined for each source of error. The ArcCHECK was able to detect errors in DLG value, MLC leaf positions, and gantry angle. The ArcCHECK was unable to detect the studied errors in collimator angle, jaw positions, and dose output.