Is it ACT yet? Real-world examples of evaluating the degree of implementation for assertive community treatment

Despite growing interest in assessment of program implementation, little is known about the best way to evaluate whether a particular program has implemented the intended service to a level that is minimally acceptable to a funding source, such as a state mental health authority. Such is the case for assertive community treatment (ACT), an evidence-based practice being widely disseminated. Using an exploratory, actuarial approach to defining program standards, this study applies different statistical criteria for determining whether or not a program meets ACT standards using the 28-item Dartmouth Assertive Community Treatment Scale. The sample consists of 51 ACT programs, 25 intensive case management programs, and 11 brokered case management programs which were compared to identify levels of fidelity that discriminated between programs, but were still attainable by the majority of ACT programs. A grading system based on mean total score for a reduced set of 21 items appeared to be most attainable, but still discriminated ACT programs from other forms of case management. Implications for setting and evaluating ACT program standards are discussed.