Virtually Certified: Development of an Online Oral Examination Phase for a National Advanced Practice Certification...

Following development of a framework to establish the scope of advanced practice for radiation therapists (APRTs), a Canadian certification process was built. This involved three independently-assessed phases: professional portfolio, case submission, and oral examination. The oral examination was to test the candidate's knowledge and capacity for decision-making. Development and piloting involved 3 elements: 1) content development, including relevant case selection, with accompanying high-fidelity imaging and resources; 2) harnessing of technology and ensuing logistics, given the desire to offer the examination online, maximizing accessibility and minimizing resources; and 3) examiner recruitment and preparation, involving a national call for interprofessional examiners, to assess across the spectrum of competencies. Each element was approached systematically, with modifications made iteratively. Three overarching challenges required ongoing attention and consideration: resource-intensiveness of building and validating cases, ensuring applicability and relevance of case content and "answers" across practice environments, and preparation of non-radiation therapist (oncologist and physicist) examiners regarding APRT standards. The resultant examination model is thought to be a robust assessment tool, well-regarded by candidates and examiners as fair and transparent, and complementary to the other certification phases. A consultatory pilot process supported establishment of a robust framework that is believed to be defensible and preliminarily valid.