Insight into conflictual relationship patterns: Development and validation of an observer rating scale

Objective: This study aimed to develop an observer-rated measure of Insight into Conflictual Relationship Patterns (ICR) applicable to audio- or videotapes of psychotherapy sessions and conduct a first psychometric evaluation. Method: We investigated the item properties, principal components, reliability, and validity of the ICR in a naturalistic sample of N = 125 outpatients in psychodynamic psychotherapy. Results: The ICR consists of 12 items that showed adequate item discrimination and item difficulty indices. All items represent one principal component. Using item response theory, discrimination parameters and item characteristic curves revealed that the ability of all items to differentiate patients was adequate to very good. The scale demonstrated good interrater reliability (ICC(3,1) = .76-.93), adequate internal consistency (Cronbach's α = .84), and high retest reliability (r = .91). Regarding validity, the ICR was significantly associated with insight according to the Achievement of Therapeutic Objectives Scale and patient-perceived session depth. Insight at session five predicted a symptomatic increase from session five to session ten. Conclusion: The ICR is an observer-rated measure to assess insight from psychotherapy session recordings that has demonstrated several aspects of reliability and validity. Future studies are needed to clarify the impact of ICR-assessed insight for symptomatic outcome.