Related Experiment Video
Updated: May 30, 2026

Continuous Theta Burst Stimulation of the Posterior Medial Frontal Cortex to Experimentally Reduce Ideological Threat Responses
Published on: September 28, 2018
Testing the allegiance bias hypothesis: a meta-analysis
Thomas Munder1, Heike Gerger, Sven Trelle
1Institute of Social and Preventive Medicine-ISPM, University of Bern, Bern, Switzerland. tmunder@ispm.unibe.ch
Abstract:
This meta-analysis investigated whether the association between researcher allegiance (RA) and the relative effect of two psychotherapies can be explained through the methodological weaknesses of the treatment comparisons. Seventy-nine comparisons of psychotherapies for depression or posttraumatic stress disorder (PTSD) were included. Methodological quality (MQ) was investigated as both a moderator and a mediator of the RA-outcome association. MQ included balanced nonspecific factors, balanced specific factors, conceptual quality, patients-per-therapist ratio, randomization to conditions and outcome assessment. The RA-outcome association was stronger when the MQ was low, suggesting a buffering effect of MQ. In addition, differences in the conceptual quality of treatments mediated the effect of RA on outcome. The results support the view that RA acts as a bias in treatment comparisons.
Insights
Researcher allegiance (RA) bias in psychotherapy research is linked to methodological weaknesses. Higher methodological quality (MQ) buffered this bias, indicating RA influences treatment outcome comparisons.
Area of Science:
- Psychiatry and Mental Health
- Clinical Psychology
- Research Methodology
Background:
- Researcher allegiance (RA) is a potential bias in psychotherapy outcome studies.
- Methodological weaknesses may exacerbate the impact of RA on treatment comparisons.
- Understanding these factors is crucial for interpreting psychotherapy research findings.
Purpose of the Study:
- To determine if methodological weaknesses explain the association between researcher allegiance and psychotherapy outcomes.
- To examine the moderating and mediating roles of methodological quality (MQ) in the RA-outcome relationship.
- To assess the influence of specific MQ components on the RA-outcome association.
Main Methods:
- Meta-analysis of 79 psychotherapy comparisons for depression and PTSD.
- Investigated MQ components: balanced factors, conceptual quality, patient-therapist ratio, randomization, and outcome assessment.
- Analyzed MQ as a moderator and mediator of the RA-outcome association.
Main Results:
- The association between researcher allegiance and relative treatment effect was stronger in studies with lower methodological quality.
- Methodological quality demonstrated a buffering effect on the RA-outcome association.
- Differences in conceptual quality of treatments mediated the effect of RA on outcomes.
Conclusions:
- Methodological weaknesses in treatment comparisons contribute to researcher allegiance bias.
- Researcher allegiance acts as a bias in psychotherapy outcome research, particularly when study quality is low.
- Improving methodological rigor is essential to mitigate bias in psychotherapy comparative effectiveness research.
Related Concept Videos
Stereotypes, Prejudice, and Discrimination
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Confirmation Biases
Social Proof
Correspondence Bias
Self-Serving Bias
