Related Experiment Video
Updated: Dec 4, 2025
06:05
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
Published on: February 19, 2021
1.5K
Development and Evaluation of a Component Level Implementation Fidelity Rating System for the GenerationPMTO
Kendal Holtrop1, Debra L Miller2, Jared A Durtschi3
1Department of Human Development and Family Studies, Michigan State University, 552 W. Circle Drive, East Lansing, MI, 48824, USA. holtropk@msu.edu.
Summary
Researchers developed a new observational rating system to measure fidelity to specific components of the GenerationPMTO parenting intervention. This tool aids in understanding which parts of evidence-based programs drive positive change.
Area of Science:
- Psychology
- Intervention Science
- Program Evaluation
Background:
- Identifying effective components of evidence-based interventions is critical for optimizing therapeutic outcomes.
- Fidelity to specific intervention components is often assumed but rarely measured at a granular level.
- The GenerationPMTO parenting intervention is an evidence-based program requiring robust fidelity assessment.
Purpose of the Study:
- To develop and evaluate an observational rating system for measuring fidelity to specific components of the GenerationPMTO parenting intervention.
- To assess the psychometric properties of the developed rating system.
- To enable a more nuanced examination of change processes within evidence-based interventions.
Main Methods:
- A five-step systematic development process involving intervention developers and experts.
- Testing the rating system using 247 hours of video data from 184 parenting group sessions.
- Evaluating item performance, reliability (inter-rater, dimensionality, internal consistency), and validity (content, convergent, discriminant, predictive).
Main Results:
- The rating system demonstrated strong psychometric properties for seven of eight evaluated components: clear directions, skill encouragement, emotion regulation, limit setting, effective communication, problem solving, and monitoring.
- Reliability and validity were supported for these seven component scales.
- Psychometric properties were not supported for the 'positive involvement' scale.
Conclusions:
- The developed observational rating system effectively measures component-specific fidelity for key elements of the GenerationPMTO intervention.
- Assessing component-specific fidelity allows for a more detailed understanding of intervention mechanisms and their impact on outcomes.
- This nuanced approach has significant implications for advancing research and improving the practice of evidence-based interventions.
Related Concept Videos
01:29Self-Evaluation Maintenance Model
164
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
164
01:21Methods of Documentation III: PIE
1.9K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.9K
01:29Reliability and Validity
13.5K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.5K
01:26Methods of Documentation II: POMR
1.2K
The Problem-Oriented Medical Record (POMR) revolutionized medical record-keeping by introducing a systematic approach focusing on the patient's problems rather than merely listing symptoms. Dr. Lawrence Weed's introduction of this method in the 1960s marked a significant advancement in medical documentation. The POMR framework consists of four key components: the database, problem list, plan of care, and progress notes.
1.2K