Fidelity Assessment in Community Programs: An Approach to Validating Simplified Methodology

Area of Science:

• Clinical Psychology
• Developmental Psychology
• Behavioral Science

Background:

• High fidelity to intervention protocols is essential for optimal outcomes in autism spectrum disorder (ASD) treatment.
• Existing fidelity measurement tools often lack the accuracy or feasibility required for widespread community-based clinical practice.

Purpose of the Study:

• To explore validated methods for simplifying fidelity assessment procedures in ASD interventions.
• To enhance the practical application of fidelity measurement in clinical settings.

Main Methods:

• Video recordings (n=36) of therapists working with children with ASD were analyzed.
• Three fidelity assessment methods were compared: trial-by-trial, 5-point Likert Scale, and 3-point Likert Scale.
• Analyses included exact agreement, mastery criterion agreement, and overall reliability (Krippendorff's alpha).

Main Results:

• Very high exact agreement (mean 99.44%) and excellent reliability (mean Kα=1.0) were observed between trial-by-trial and 5-point Likert Scale methods.
• The 3-point Likert Scale method demonstrated strong agreement and reliability comparable to the 5-point scale.
• The 3-point method emerged as a potentially more feasible option for community programs.

Conclusions:

• Simplified fidelity assessment tools can maintain high accuracy and reliability for ASD interventions.
• The 3-point Likert Scale offers a feasible and effective alternative for community-based fidelity monitoring.
• Validated simplification of fidelity assessment can increase its use in clinical practice, improving intervention outcomes.