Related Experiment Video
Updated: Jul 30, 2025
Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
Development and evaluation of a fidelity tool in a post-discharge responsive parenting intervention program for very
Monique Flierman1, Eline Vriend1, Aleid G Leemhuis2
1Amsterdam UMC, University of Amsterdam, Department of Rehabilitation, Amsterdam Reproduction and development, Meibergdreef 9, Amsterdam, the Netherlands.
Insights
A new fidelity tool was developed for the TOP program, a parenting intervention for preterm infants. This reliable tool ensures adherence and supports evidence-based adaptations for better outcomes.
Area of Science:
- Child Development
- Intervention Science
- Psychometrics
Background:
- Fidelity monitoring is crucial for maintaining intervention integrity and effectiveness.
- The TOP program, a responsive parenting intervention, requires a robust fidelity assessment.
- Developing reliable tools is essential for evidence-based practice in early intervention.
Purpose of the Study:
- To develop and evaluate the reliability of a fidelity tool for the TOP program.
- To employ an iterative and co-creative process for tool development.
- To assess the psychometric properties of the newly developed fidelity tool.
Main Methods:
- A three-phase approach including initial development, pilot testing (self-report and video observation), and refinement.
- Psychometric evaluation using 20 intervention videos rated by three independent experts.
- Analysis of interrater reliability (ICC) and correlations (Spearman's rho) for adherence, competence, and overall impression.
Main Results:
- The developed fidelity tool demonstrated good to excellent interrater reliability for adherence and competence subscales (ICC .81–.84).
- Specific items showed moderate to excellent reliability (ICC .51–.98).
- High correlations were found between subscales and the total impression item (rho .79–.82).
Conclusions:
- The iterative and co-creative development process yielded a clinically useful and reliable fidelity assessment tool for the TOP program.
- The study provides practical insights for developing fidelity assessment tools applicable to other interventions.
- The reliable tool supports program adherence, outcome evaluation, and evidence-based adaptations in early intervention programs.
Abstract:
The TOP program is a fully implemented responsive parenting intervention for very preterm born infants. Fidelity monitoring of interventions is important for preserving program adherence, impact outcomes and to make evidence-based adaptations. The aim of this study was to develop a fidelity tool for the TOP program following an iterative and co-creative process and subsequently evaluate the reliability of the tool. Three consecutive phases were carried out. Phase I: Initial development and pilot testing two methods namely self-report and video based observation. Phase II: Adaptations and refinements. Phase III: Evaluation of the psychometric properties of the tool based on 20 intervention videos rated by three experts.The interrater reliability of the adherence and competence subscales was good (ICC.81 to .84) and varied from moderate to excellent for specific items (ICC between .51 and .98). The FITT displayed a high correlation (Spearman's rho.79 to.82) between the subscales and total impression item. The co-creative and iterative process resulted in a clinical useful and reliable tool for evaluating fidelity in the TOP program. This study offers insights in the practical steps in the development of a fidelity assessment tool which can be used by other intervention developers.
