A methodological review with meta-epidemiological analysis of preclinical systematic reviews with meta-analyses

Noémie Simon-Tillaux1, Anne-Laure Gerard1, Deivanes Rajendrabose1

  • 1Sorbonne Université, INSERM, Institut Pierre Louis d'Epidémiologie et de Santé Publique, Département de Santé Publique, Centre de Pharmacoépidémiologie (Cephepi), Unité de Recherche Clinique PSL-CFX, CIC-1901, AP-HP, Hôpital Pitié Salpêtrière, 75013, Paris, France.

Scientific Reports
|November 22, 2022
PubMed

Insights

Systematic reviews of preclinical studies show improved methods but poor study quality, limiting results. Meta-analysis found no link between study characteristics and effect size, highlighting a need for better preclinical research quality.

Area of Science:

  • Preclinical research methodology
  • Systematic review and meta-analysis evaluation
  • Scientific literature synthesis

Background:

  • Systematic reviews and meta-analyses are crucial for synthesizing preclinical study findings.
  • Concerns exist regarding the methodological quality of both the reviews and the included studies.
  • Evaluating these aspects is vital for reliable scientific evidence.

Purpose of the Study:

  • To assess the methodology of systematic reviews and meta-analyses of preclinical studies.
  • To evaluate the methodological quality of studies included in these reviews.
  • To determine if study characteristics influence the observed effect sizes.

Main Methods:

  • Conducted a literature search on MEDLINE for systematic reviews with meta-analyses of preclinical studies (Jan 2018 - Mar 2020).
  • Analyzed review methodologies, including grey literature exploration, duplicate processes, and risk of bias assessment.
  • Performed meta-epidemiological analysis to investigate the association between study characteristics and effect size.

Main Results:

  • Less than 15% of reviews explored grey literature; duplicate processes were used in less than two-thirds.
  • Most reviews assessed included study quality and reported meta-analysis models, but risk of bias was often unclear.
  • Meta-epidemiological analysis revealed no association between study methodological characteristics and effect size.

Conclusions:

  • Methodological characteristics of systematic reviews for preclinical studies have improved.
  • However, the poor methodological quality of included preclinical studies continues to limit the validity of synthesized results.
  • No evidence was found linking study characteristics to effect size in this meta-epidemiological analysis.

Related Concept Videos

Preclinical Development: Overview01:28

Preclinical Development: Overview

Preclinical development consists of a series of tests that ensure the safety and efficacy of a new therapeutic compound before it is tested in humans. There are four main phases to this process. First, safety pharmacology tests are conducted to ensure the drug does not produce any acutely harmful effects. These tests examine parameters such as bronchoconstriction, cardiac dysrhythmias, blood pressure changes, and ataxia. Next, preliminary toxicological testing is performed to determine the...
4.5K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
157
Study Designs in Epidemiology01:20

Study Designs in Epidemiology

Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
352
Clinical Trials01:16

Clinical Trials

Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
6.9K
Introduction to Epidemiology01:26

Introduction to Epidemiology

Epidemiology, known as the cornerstone of public health, involves studying the distribution and determinants of health-related events in defined populations and applying these insights to control health issues. This is essential for understanding how diseases spread, identifying populations at greater risk, and implementing measures to control or prevent outbreaks. Epidemiology addresses not only infectious diseases but also non-communicable conditions like cancer and cardiovascular disease,...
897
Statistical Methods for Analyzing Epidemiological Data01:25

Statistical Methods for Analyzing Epidemiological Data

Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
480