Evidence that therapy works in clinically representative conditions

Area of Science:

• Psychology
• Clinical Psychology
• Psychotherapy Research

Background:

• Meta-analyses synthesize findings from multiple studies to estimate treatment effects.
• Assessing the clinical representativeness of studies is crucial for generalizing research findings to real-world practice.
• Previous meta-analyses have varied in their criteria for including studies.

Purpose of the Study:

• To conduct a secondary analysis of existing therapy outcome meta-analyses.
• To compare effect sizes from studies meeting increasingly stringent criteria for clinical representativeness.
• To evaluate the generalizability of psychotherapy research findings to clinical settings.

Main Methods:

• Synthesized effect sizes from 56 studies across 15 meta-analyses.
• Applied three levels of increasingly stringent criteria for clinical representativeness.
• Compared synthesized effect sizes with those reported in original meta-analyses.

Main Results:

• Effect sizes remained consistent across all three levels of clinical representativeness criteria.
• A significant lack of studies met the most stringent criteria for clinical representativeness.
• The generalizability of psychotherapy research to clinical conditions may be limited by the availability of representative studies.

Conclusions:

• The magnitude of psychotherapy effects does not appear to change when studies are more clinically representative.
• There is a scarcity of research that rigorously tests therapies under conditions that closely mirror clinical practice.
• Further research is needed to refine criteria for clinical representativeness and explore alternative models for assessing generalizability.