Related Experiment Video
Updated: Aug 15, 2026
08:05
Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
Randomized controlled versus naturalistic studies: a new research agenda
1Clinic of Tiefenbrunn, Clinic of Psychosomatics and Psychotherapy, University of Göttingen, Göttingen, Germany. fleichs@gwgd.de
Bulletin of the Menninger Clinic
|July 21, 2004
Summary
Randomized controlled trials (RCTs) and naturalistic studies assess psychotherapy in different settings. Naturalistic studies are crucial for demonstrating real-world treatment effectiveness and require distinct evidence criteria.
Area of Science:
- Psychotherapy Research
- Scientific Methodology
- Evidence-Based Practice
Background:
- Current evidence hierarchies often prioritize randomized controlled trials (RCTs).
- The applicability of RCT findings to real-world clinical settings is debated.
- A structuralistic view of scientific theories offers a framework for evaluating different study designs.
Purpose of the Study:
- To critically examine the evidence required to demonstrate psychotherapy effectiveness.
- To differentiate the roles and validity of RCTs versus naturalistic studies.
- To propose a framework for evaluating evidence from naturalistic studies.
Main Methods:
- Application of the structuralistic view of theories to psychotherapy research.
- Comparative analysis of randomized controlled studies (RCTs) and naturalistic studies (effectiveness studies).
- Conceptual development of evidence levels for naturalistic research.
Main Results:
- RCTs and naturalistic studies are valid for different application domains (laboratory vs. field).
- Evidence from RCTs may not directly transfer to clinical practice.
- Naturalistic studies are essential for demonstrating field effectiveness and require separate evidence criteria.
Conclusions:
- A paradigm shift is needed to recognize the distinct value of naturalistic studies in psychotherapy research.
- Existing evidence hierarchies focusing solely on RCTs are insufficient for assessing real-world effectiveness.
- A new research agenda and gold standard for naturalistic studies are proposed.
Related Concept Videos
02:30Naturalistic Observations
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
01:11Observational Studies
Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
01:13Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:20Study Designs in Epidemiology
Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and case-control studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and case-control studies.