Methods for measuring implementation fidelity to the transitional care model.

Area of Science:

• Healthcare Implementation Science
• Clinical Intervention Evaluation

Background:

• Intervention fidelity is crucial for valid outcome assessment, preventing confounding implementation variability with efficacy.
• The MIRROR-TCM study evaluated the Transitional Care Model (TCM), a 10-component intervention supporting older adults post-hospitalization.
• A key objective was operationalizing a fidelity measure for the TCM intervention.

Purpose of the Study:

• To describe the development and operationalization of a novel fidelity measure for the Transitional Care Model (TCM) intervention.
• To establish a method for assessing fidelity at element, component, and overall intervention levels.
• To create a flexible scoring system accommodating real-world implementation variations.

Main Methods:

• Fidelity was operationalized across 38 elements organized into 8 TCM components.
• Element-level fidelity scores (0/1) were defined by clinicians and statisticians, refined with provider feedback.
• Component and overall fidelity scores were calculated as proportions of completed elements, incorporating rule-based exemptions.

Main Results:

• A comprehensive TCM fidelity score was developed, integrating 38 elements and 8 components.
• A novel methodology for flexible fidelity scoring in multicomponent interventions was established.
• The fidelity measure allowed for rule-based exemptions, accommodating participant-specific needs and implementation variability.

Conclusions:

• Accurate fidelity evaluation is essential for assessing intervention implementation.
• The developed fidelity measure offers a flexible approach for complex, multicomponent interventions.
• Future work includes validating the metric by linking fidelity to clinical outcomes in the MIRROR-TCM study.