Related Experiment Video
Updated: Dec 14, 2025

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Multi-method process maps: An interdisciplinary approach to investigate ad hoc modifications in protocol-driven
Thomas I Mackie1,2, Leah Ramella3, Ana J Schaefer1
1Rutgers School of Public Health, Piscataway, NJ, USA.
Introduction:
Implementation scientists increasingly recognize that the process of implementation is dynamic, leading to ad hoc modifications that may challenge fidelity in protocol-driven interventions. However, limited attention to ad hoc modifications impairs investigators' ability to develop evidence-based hypotheses about how such modifications may impact intervention effectiveness and cost. We propose a multi-method process map methodology to facilitate the systematic data collection necessary to characterize ad hoc modifications that may impact primary intervention outcomes.
Methods:
We employ process maps (drawn from systems science), as well as focus groups and semi-structured interviews (drawn from social sciences) to investigate ad hoc modifications. Focus groups are conducted with the protocol's developers and/or planners (the implementation team) to characterize the protocol "as envisioned," while interviews conducted with frontline administrators characterize the process "as realized in practice." Process maps with both samples are used to identify when modifications occurred across a protocol-driven intervention. A case study investigating a multistage screening protocol for autism spectrum disorders (ASD) is presented to illustrate application and utility of the multi-method process maps.
Results:
In this case study, frontline administrators reported ad hoc modifications that potentially influenced the primary study outcome (e.g., time to ASD diagnosis). Ad hoc modifications occurred to accommodate (1) whether providers and/or parents were concerned about ASD, (2) perceptions of parental readiness to discuss ASD, and (3) perceptions of family service delivery needs and priorities.
Conclusion:
Investigation of ad hoc modifications on primary outcomes offers new opportunities to develop empirically based adaptive interventions. Routine reporting standards are critical to provide full transparency when studying ad hoc modifications.
More Related Videos
Related Concept Videos
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic...
Modeling in Therapy
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Methods of Documentation II: POMR
Methods of Documentation IV: Focus Charting
It typically involves three columns for recording information:
Mechanistic Models: Overview of Compartment Models
The Scientific Method

