Feasibility of Using Simulation to Evaluate Implementation Fidelity in an Advance Care Planning Pragmatic Trial

Background and Objectives: Traditional methods of fidelity monitoring are not possible in pragmatic trials in real-world clinical settings. We describe our approach to monitoring and reinforcing the fidelity to ACP conversations for a hard-to-reach subpopulation by using standardized patients in a pragmatic trial. Research Design and Methods: We developed standardized patient scenarios grounded in the Respecting Choices First Steps™ Advance Care Planning curriculum to provide an opportunity to reinforce and assess ACP facilitator competency. Scenarios represented one-on-one encounters. The first case was a standardized patient with cognitive impairment and the second case involved a standardized patient with dementia and their care partner. A previously validated fidelity checklist was used to score skills and behaviors observed during simulations including encounter set-up, ACP topics, and general communication. Simulations involved voice teleconferencing to align primary modality of ACP in the pragmatic trial. Results: Six facilitators completed two standardized patient cases each. Overall fidelity scores were moderately high (78.8% ± 11.7; 63.4 - 95.6) for the case with cognitive impairment and for the case with the patient with dementia and care partner (76.2% ± 13.0; 54.4 - 91.5). Discussion and Implications: Simulation using standardized patients supported fidelity monitoring and provided coachable feedback to support facilitator competency. Our study can help inform future research and training related to advance care planning in older adults living with Alzheimer's disease and related disorders.