Related Experiment Video
Updated: Aug 20, 2025

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
A methodological review with meta-epidemiological analysis of preclinical systematic reviews with meta-analyses
Noémie Simon-Tillaux1, Anne-Laure Gerard1, Deivanes Rajendrabose1
1Sorbonne Université, INSERM, Institut Pierre Louis d'Epidémiologie et de Santé Publique, Département de Santé Publique, Centre de Pharmacoépidémiologie (Cephepi), Unité de Recherche Clinique PSL-CFX, CIC-1901, AP-HP, Hôpital Pitié Salpêtrière, 75013, Paris, France.
Abstract:
Systematic reviews and meta-analyses have been proposed as an approach to synthesize the literature and counteract the lack of power of small preclinical studies. We aimed to evaluate (1) the methodology of these reviews, (2) the methodological quality of the studies they included and (3) whether study methodological characteristics affect effect size. We searched MEDLINE to retrieve 212 systematic reviews with meta-analyses of preclinical studies published from January, 2018 to March, 2020. Less than 15% explored the grey literature. Selection, data extraction and risk of bias assessment were performed in duplicate in less than two thirds of reviews. Most of them assessed the methodological quality of included studies and reported the meta-analysis model. The risk of bias of included studies was mostly rated unclear. In meta-epidemiological analysis, none of the study methodological characteristics was associated with effect size. The methodological characteristics of systematic reviews with meta-analyses of recently published preclinical studies seem to have improved as compared with previous assessments, but the methodological quality of included studies remains poor, thus limiting the validity of their results. Our meta-epidemiological analysis did not show any evidence of a potential association between methodological characteristics of included studies and effect size.
Insights
Systematic reviews of preclinical studies show improved methods but poor study quality, limiting results. Meta-analysis found no link between study characteristics and effect size, highlighting a need for better preclinical research quality.
Area of Science:
- Preclinical research methodology
- Systematic review and meta-analysis evaluation
- Scientific literature synthesis
Background:
- Systematic reviews and meta-analyses are crucial for synthesizing preclinical study findings.
- Concerns exist regarding the methodological quality of both the reviews and the included studies.
- Evaluating these aspects is vital for reliable scientific evidence.
Purpose of the Study:
- To assess the methodology of systematic reviews and meta-analyses of preclinical studies.
- To evaluate the methodological quality of studies included in these reviews.
- To determine if study characteristics influence the observed effect sizes.
Main Methods:
- Conducted a literature search on MEDLINE for systematic reviews with meta-analyses of preclinical studies (Jan 2018 - Mar 2020).
- Analyzed review methodologies, including grey literature exploration, duplicate processes, and risk of bias assessment.
- Performed meta-epidemiological analysis to investigate the association between study characteristics and effect size.
Main Results:
- Less than 15% of reviews explored grey literature; duplicate processes were used in less than two-thirds.
- Most reviews assessed included study quality and reported meta-analysis models, but risk of bias was often unclear.
- Meta-epidemiological analysis revealed no association between study methodological characteristics and effect size.
Conclusions:
- Methodological characteristics of systematic reviews for preclinical studies have improved.
- However, the poor methodological quality of included preclinical studies continues to limit the validity of synthesized results.
- No evidence was found linking study characteristics to effect size in this meta-epidemiological analysis.
More Related Videos
04:34Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia
Published on: February 17, 2023
06:26Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI
Published on: November 27, 2019
Related Concept Videos
Preclinical Development: Overview
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Clinical Trials
There are four phases in a clinical trial. A phase one...
Introduction to Epidemiology
Statistical Methods for Analyzing Epidemiological Data