Fidelity at a distance: assessing implementation fidelity of the Early Risers prevention program in a going-to-scale...

The present study examined the feasibility of an innovative technology designed to assess implementation fidelity of the Early Risers conduct problems prevention program across 27 geographically dispersed school sites. A multidimensional construct of fidelity was used to assess the quantity of services provided (exposure), the degree to which program strategies conformed to the manual (adherence), and how well implementers delivered the program (quality of delivery). The measurement technology featured a fidelity monitoring system that required (a) weekly reporting on a web-based documentation system to assess program exposure and adherence, and (b) five annually administered telephone interviews with a technical assistant to assess quality of program implementation. The results showed that the fidelity monitoring system was feasible, with all sites achieving 100% compliance in completion of their required on-line reporting and on average over 80% of the required teleconference interviews. User feedback indicated satisfaction with the web-based program. The system was successful in measuring multiple indices of fidelity. The strengths and limitations of measuring fidelity at a distance with web-based and teleconferencing technologies are discussed.