Testing the allegiance bias hypothesis: a meta-analysis

Thomas Munder1, Heike Gerger, Sven Trelle

  • 1Institute of Social and Preventive Medicine-ISPM, University of Bern, Bern, Switzerland. tmunder@ispm.unibe.ch

Insights

Researcher allegiance (RA) bias in psychotherapy research is linked to methodological weaknesses. Higher methodological quality (MQ) buffered this bias, indicating RA influences treatment outcome comparisons.

Area of Science:

  • Psychiatry and Mental Health
  • Clinical Psychology
  • Research Methodology

Background:

  • Researcher allegiance (RA) is a potential bias in psychotherapy outcome studies.
  • Methodological weaknesses may exacerbate the impact of RA on treatment comparisons.
  • Understanding these factors is crucial for interpreting psychotherapy research findings.

Purpose of the Study:

  • To determine if methodological weaknesses explain the association between researcher allegiance and psychotherapy outcomes.
  • To examine the moderating and mediating roles of methodological quality (MQ) in the RA-outcome relationship.
  • To assess the influence of specific MQ components on the RA-outcome association.

Main Methods:

  • Meta-analysis of 79 psychotherapy comparisons for depression and PTSD.
  • Investigated MQ components: balanced factors, conceptual quality, patient-therapist ratio, randomization, and outcome assessment.
  • Analyzed MQ as a moderator and mediator of the RA-outcome association.

Main Results:

  • The association between researcher allegiance and relative treatment effect was stronger in studies with lower methodological quality.
  • Methodological quality demonstrated a buffering effect on the RA-outcome association.
  • Differences in conceptual quality of treatments mediated the effect of RA on outcomes.

Conclusions:

  • Methodological weaknesses in treatment comparisons contribute to researcher allegiance bias.
  • Researcher allegiance acts as a bias in psychotherapy outcome research, particularly when study quality is low.
  • Improving methodological rigor is essential to mitigate bias in psychotherapy comparative effectiveness research.

Related Concept Videos

Stereotypes, Prejudice, and Discrimination02:55

Stereotypes, Prejudice, and Discrimination

Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who are...
Bias01:22

Bias

Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Confirmation Biases01:31

Confirmation Biases

The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
Social Proof00:52

Social Proof

Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
Correspondence Bias01:17

Correspondence Bias

Correspondence bias, also referred to as the fundamental attribution error, describes the tendency to attribute another person’s behavior to internal characteristics rather than situational influences. This cognitive bias leads individuals to overlook external factors that may be influencing actions, thereby fostering potentially inaccurate assessments of others’ intentions and dispositions.Empirical Evidence for Correspondence BiasResearch has consistently demonstrated the prevalence of...
Self-Serving Bias01:29

Self-Serving Bias

Self-serving bias is a cognitive phenomenon in which individuals attribute positive outcomes to internal factors such as their abilities, intelligence, or effort while attributing negative outcomes to external circumstances. This cognitive distortion helps maintain self-esteem but can also impede objective self-assessment.Theoretical Explanations of Self-Serving BiasTwo primary theories explain the self-serving bias: the cognitive explanation and the motivational explanation.The cognitive...