Related Experiment Video
Updated: May 7, 2026

Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
Development of a scale to measure fidelity to manualized group-based cognitive behavioural interventions for people
Andrew Jahoda1, Paul Willner, John Rose
1Institute of Health and Wellbeing, College of Medical, Veterinary and Life Sciences, University of Glasgow, UK.
Abstract:
The context for the present study was a cluster-randomized controlled trial of a group-based anger-management intervention, delivered by day-service staff. We aimed to develop a scale to measure the fidelity of manualized cognitive-behavioural therapy (CBT) delivered to adults with intellectual disabilities in group-based settings. A 30-item monitoring instrument (the MAnualized Group Intervention Check: MAGIC) was adapted from an existing fidelity-monitor instrument for individual CBT. Two sessions for 27 groups were observed by pairs of monitors who had no other contact with the intervention. 16 observers participated, in 15 unique pairings. Observers recorded high levels of inter-rater reliability and the scale had good internal consistency. Fidelity ratings predicted two key outcomes of the intervention, and were themselves predicted by the therapists' clinical supervisors.