Assessing initial plan check efficacy using TG 275 failure modes and incident reporting

Plan checks are important components of a robust quality assurance (QA) program. Recently, the American Association of Physicists in Medicine (AAPM) published two reports concerning plan and chart checking, Task Group (TG) 275 and Medical Physics Practice Guideline (MPPG) 11.A. The purpose of the current study was to crosswalk initial plan check failure modes revealed in TG 275 against our institutional QA program and local incident reporting data. Ten physicists reviewed 46 high-risk failure modes reported in Table S1.A.i of the TG 275 report. The committee identified steps in our planning process which sufficiently checked each failure mode. Failure modes that were not covered were noted for follow-up. A multidisciplinary committee reviewed the narratives of 1599 locally-reported incidents in our Radiation Oncology Incident Learning System (ROILS) database and categorized each into the high-risk TG 275 failure modes. We found that over half of the 46 high-risk failure modes, six of which were top-ten failure modes, were covered in part by daily contouring peer-review rounds, upstream of the traditional initial plan check. Five failure modes were not adequately covered, three of which concerned pregnancy, pacemakers, and prior dose. Of the 1599 incidents analyzed, 710 were germane to the initial plan check, 23.4% of which concerned missing pregnancy attestations. Most, however, were caught prior to CT simulation (98.8%). Physics review and initial plan check were the least efficacious checks, with error detection rates of 31.8% and 31.3%, respectively, for some failure modes. Our QA process that includes daily contouring rounds resulted in increased upstream error detection. This work has led to several initiatives in the department, including increased automation and enhancement of several policies and procedures. With TG 275 and MPPG 11.A as a guide, we strongly recommend that departments consider an internal chart checking policy and procedure review.