Related Experiment Video
Updated: Oct 1, 2025

Group Synchronization During Collaborative Drawing Using Functional Near-Infrared Spectroscopy
Published on: August 5, 2022
In Search of Reliability: Expert-Informed Training Methods for Conducting Observational Coding of Cognitive
Natalie Rodriguez-Quintana1,2, Madison R Walker3, Cara C Lewis4
1Indiana University, Bloomington, Indiana nataliro@med.umich.edu.
Background:
Observational coding is the gold standard for measuring treatment fidelity; however, the intensive training needed for reliable and valid measurement has not been carefully scrutinized. A systematic review concluded there is a lack of information in published studies on how to approach training raters, and the available content suggests widely variable approaches are taken across research teams. The quality and comparability of the data produced from these treatment fidelity measures is undermined by heterogeneous training approaches occurring both within and between coding teams. No guidance for training teams to do observational coding for fidelity is currently available. The aims of the current study were to: (a) characterize expert-informed processes for observational coding regarding training, coding, and achieving reliability, and (b) generate expert recommendations for training and conducting observational coding.
Method:
A semi-structured interview was used to explore international CBT expert's (N = 11) perspectives and experiences regarding observational coding training processes. A qualitative content analysis approach was used to analyze the data.
Results:
Experts in the study provided information about their training, coding, and reliability processes.
Conclusion:
Results from this study informed recommendations on how to: (a) introduce scale items, (b) anchor ratings, and (c) drift prevention.
More Related Videos
08:42A Familiarization Protocol Facilitates the Participation of Children with ASD in Electrophysiological Research
Published on: July 31, 2017
09:14Exploring the Neural Correlates of Cognitive Reappraisal in Obsessive-Compulsive Disorder Using Task-based Functional Magnetic Resonance Imaging
Published on: March 14, 2025
Related Concept Videos
Modeling in Therapy
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Cognitive Therapy
Naturalistic Observations
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
Operant Conditioning Intervention
In operant conditioning, behaviors that are...
Behavior Therapy
Exposure therapy is a cornerstone of behavioral treatment for anxiety disorders. It involves systematic exposure to feared stimuli, either in real...