A review of methods for comparing treatments evaluated in studies that form disconnected networks of evidence

John W Stevens1, Christine Fletcher2, Gerald Downey2

  • 1School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, UK.

Insights

Network meta-analysis can compare treatments across disconnected studies. This review discusses statistical methods for handling imbalances and uncertainty in these complex evidence networks.

Area of Science:

  • Biostatistics
  • Clinical Epidemiology
  • Health Technology Assessment

Background:

  • Network meta-analysis (NMA) enables simultaneous comparison of multiple treatments in randomized controlled trials.
  • Estimating treatment effects across disconnected networks of evidence presents unique statistical challenges.
  • Imbalances in prognostic variables and treatment effect modifiers require specialized modeling assumptions.

Purpose of the Study:

  • To review and discuss statistical methods for comparing treatments within disconnected evidence networks.
  • To highlight the importance of clinical context and data availability in selecting appropriate methods.
  • To identify gaps in current methodologies regarding uncertainty quantification.

Main Methods:

  • Review of existing statistical approaches for disconnected network meta-analysis.
  • Discussion of methods addressing prognostic variable and treatment effect modifier imbalances.
  • Analysis of uncertainty sources, including sampling variation and external information incorporation.

Main Results:

  • Several methods exist for disconnected network meta-analysis, with varying applicability based on clinical context and data.
  • Most methods address sampling variation but may not fully account for other uncertainty sources.
  • The need for further research into method properties and incorporation of external information is highlighted.

Conclusions:

  • Comparing treatments in disconnected networks requires careful consideration of statistical methods and data.
  • Current methods often require further development to comprehensively address all sources of uncertainty.
  • Future research should focus on robust methods that incorporate external data to improve parameter and structural uncertainty estimation.

Related Concept Videos

Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
636
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Body:Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
242
Hazard Ratio01:12

Hazard Ratio

The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial...
642
Bioequivalence Experimental Study Designs: Completely Randomized and Randomized Block Designs01:20

Bioequivalence Experimental Study Designs: Completely Randomized and Randomized Block Designs

Body:Bioequivalence experimental study designs are crucial methodologies used in evaluating and comparing the bioavailability of different drug products. These designs are categorized into various types: completely randomized, randomized block, repeated measures, cross and carry-over, and Latin square designs.Completely randomized designs involve randomly allocating treatments to all subjects participating in the experiment. This allocation is achieved by assigning unique random numbers to...
273
Crossover Experiments01:16

Crossover Experiments

Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
4.6K
Study Designs in Epidemiology01:20

Study Designs in Epidemiology

Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
1.1K