DEPERROR: Risks of systematic errors in drug and non-drug randomized clinical trials assessing intervention effects

Jesper Krogh1, Carsten Rygaard Hjorthøj1, Janus Christian Jakobsen2

  • 1Mental Health Centre Copenhagen, University of Copenhagen, Copenhagen, Denmark.

Abstract

Insights

Randomized clinical trials for depression often have systematic errors. Drug trials showed better blinding, while non-drug trials had superior methodology, though both had high risks of bias.

Area of Science:

  • Clinical Trials Methodology
  • Psychiatry Research
  • Evidence-Based Medicine

Background:

  • Systematic errors in randomized clinical trials (RCTs) can overestimate treatment effects.
  • Assessing risks of bias is crucial for evaluating interventions for unipolar depression.

Purpose of the Study:

  • To systematically assess the risks of bias in RCTs for unipolar depression interventions.
  • To compare bias risks between drug and non-drug trials.
  • To examine trends in bias over time.

Main Methods:

  • Searched bibliographic databases for drug and non-drug RCTs in depression.
  • Assessed bias across domains: sequence generation, allocation concealment, blinding, intention-to-treat, selective reporting, funding.
  • Compared bias risks by intervention type and publication year (pre-1990, 1990-1999, 2000-2010).

Main Results:

  • Drug trials (N=775) showed better blinding (participants, providers, assessors) than non-drug trials (N=73).
  • Non-drug trials demonstrated superiority in sequence generation, allocation concealment, intention-to-treat, and baseline balance.
  • For-profit funding was higher in drug trials (41.5%) vs. non-drug trials (12.3%).
  • Risk of bias decreased over time in drug trials, but not significantly in non-drug trials.

Conclusions:

  • RCTs for depression included in this study (published before 2010) had high risks of bias.
  • These biases may distort treatment effect estimates.
  • Bias risks have decreased over time for drug trials, indicating methodological improvements.

Related Concept Videos

Blind Procedures02:07

Blind Procedures

Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
13.9K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
575
Drug Toxicity: Risk factors01:24

Drug Toxicity: Risk factors

Adverse Drug Reactions (ADRs) are potential complications that arise during pharmacotherapy, influenced by multiple risk factors. Age plays a significant role; both neonates and the elderly are at heightened risk due to their respective immature and diminished metabolic and elimination processes. Gender also impacts ADRs, with females experiencing a 1.5 to 1.7-fold greater risk than males, which may be linked to pharmacokinetic, pharmacodynamic, and hormonal differences. Notably, neonates, the...
210
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
11.5K
Nonlinear Pharmacokinetics: Dependence of Elimination Half-Life and Dose Clearance01:23

Nonlinear Pharmacokinetics: Dependence of Elimination Half-Life and Dose Clearance

The elimination half-life and drug clearance of drugs following nonlinear kinetics can vary with dosage. The Michaelis-Menten parameters and drug concentration influence these factors. As the dose increases, the elimination half-life tends to lengthen, resulting in a reduction in clearance and a disproportionately larger area under the curve. The total clearance can be derived from the Michaelis-Menten equation for drugs following a one-compartment model.
A study on guinea pigs examined the...
903
Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
7.3K