Related Experiment Video
Updated: Jun 10, 2026

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials
Published on: April 19, 2024
Evaluating novel agent effects in multiple-treatments meta-regression
Georgia Salanti1, Sofia Dias, Nicky J Welton
1Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece. gsalanti@cc.uoi.gr
Abstract:
Multiple-treatments meta-analyses are increasingly used to evaluate the relative effectiveness of several competing regimens. In some fields which evolve with the continuous introduction of new agents over time, it is possible that in trials comparing older with newer regimens the effectiveness of the latter is exaggerated. Optimism bias, conflicts of interest and other forces may be responsible for this exaggeration, but its magnitude and impact, if any, needs to be formally assessed in each case. Whereas such novelty bias is not identifiable in a pair-wise meta-analysis, it is possible to explore it in a network of trials involving several treatments. To evaluate the hypothesis of novel agent effects and adjust for them, we developed a multiple-treatments meta-regression model fitted within a Bayesian framework. When there are several multiple-treatments meta-analyses for diverse conditions within the same field/specialty with similar agents involved, one may consider either different novel agent effects in each meta-analysis or may consider the effects to be exchangeable across the different conditions and outcomes. As an application, we evaluate the impact of modelling and adjusting for novel agent effects for chemotherapy and other non-hormonal systemic treatments for three malignancies. We present the results and the impact of different model assumptions to the relative ranking of the various regimens in each network. We established that multiple-treatments meta-regression is a good method for examining whether novel agent effects are present and estimation of their magnitude in the three worked examples suggests an exaggeration of the hazard ratio by 6 per cent (2-11 per cent).
Insights
Multiple-treatments meta-analyses can exaggerate new drug effectiveness. A novel Bayesian meta-regression model assesses and adjusts for this "novelty bias," finding a 6% average hazard ratio exaggeration in cancer treatments.
Area of Science:
- Medical research methodology
- Biostatistics
- Evidence synthesis
Background:
- Multiple-treatments meta-analyses are crucial for comparing competing medical regimens.
- Newer treatments in evolving fields may show exaggerated effectiveness due to novelty bias.
- This bias, stemming from optimism or conflicts of interest, is difficult to detect in pairwise meta-analyses.
Purpose of the Study:
- To develop and validate a statistical model for detecting and adjusting for novelty bias in multiple-treatments meta-analyses.
- To quantify the magnitude of novelty bias in comparative effectiveness research.
- To assess the impact of adjusting for novelty bias on treatment rankings.
Main Methods:
- Developed a Bayesian multiple-treatments meta-regression model.
- Applied the model to analyze chemotherapy and non-hormonal systemic treatments for three malignancies.
- Explored different assumptions regarding the exchangeability of novel agent effects across studies.
Main Results:
- The developed meta-regression model effectively identifies and quantifies novel agent effects.
- In the analyzed cancer treatment networks, novelty bias led to an estimated 6% exaggeration of the hazard ratio (95% credible interval: 2-11%).
- Adjusting for novelty bias altered the relative rankings of different treatment regimens.
Conclusions:
- Multiple-treatments meta-regression is a valuable tool for assessing novelty bias in comparative effectiveness research.
- Novelty bias can systematically overestimate the effectiveness of newer agents.
- Accounting for novelty bias provides a more accurate assessment of treatment efficacy and ranking.
Related Concept Videos
Comparing the Survival Analysis of Two or More Groups
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Multiple Regression
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Pharmacodynamic Models: Additive and Proportional Drug Effect Model
Combined Effects of Drugs: Antagonism
The most common type is receptor antagonism, where one drug acts as an antagonist to block the effects of another drug by...
Bioavailability Study Design: Single Versus Multiple Dose Studies
