Balancing Standardization and Ecological Validity in the Measurement of Social Communication Intervention Outcomes

Area of Science:

• Developmental Psychology
• Speech-Language Pathology
• Autism Spectrum Disorder Research

Background:

• Caregiver-mediated communication interventions are crucial for autistic toddlers.
• Current outcome measurement methods vary in settings, materials, and activities, impacting consistency.
• The ecological validity of standardized assessment contexts for capturing real-world intervention outcomes remains unclear.

Purpose of the Study:

• To investigate differences in intervention outcomes between family-selected and standardized interactional contexts.
• To determine if standardized contexts equitably capture caregiver and child outcomes representative of typical dyadic interactions.
• To explore the representativeness of standardized materials compared to family-chosen activities for autistic toddlers.

Main Methods:

• An 8-week caregiver-mediated telehealth intervention was delivered to 22 dyads.
• Caregiver fidelity and child communicative acts were measured in two contexts: family-selected activities and standardized toys.
• A routines checklist assessed valued, enjoyable, frequent, and difficult activities for families.

Main Results:

• No significant differences were found in caregiver or child outcomes between the two contexts.
• Standardized toy sets appear representative of materials families commonly select.
• Families utilized additional materials/activities in the family-selected context not present in the standardized one.

Conclusions:

• Measuring intervention outcomes in ecologically valid contexts is essential for accurate and equitable assessment.
• An expansive approach to standardization is needed to reflect families' everyday routines and functional outcomes.
• Findings support the use of varied contexts to capture the full spectrum of intervention effects.