Related Experiment Video
Updated: Dec 16, 2025

Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia
Published on: February 17, 2023
Meta-Analysing Methodological Quality of Published Research: Importance and Effectiveness
Izet Masic1, Slobodan M Jankovic2
1Academy of Medical Sciences of Bosnia and Herzegovina, Sarajevo, B&H.
Experimental study design flaws are common in preclinical research. Despite higher citations, high-impact factor journals published studies with similar design issues, risking inaccurate conclusions.
Area of Science:
- Biomedical Research
- Experimental Design Principles
Background:
- Inappropriate experimental design in medicine leads to inaccurate results and biased conclusions.
- Evaluating the implementation of basic research design principles is crucial for scientific integrity.
Purpose of the Study:
- To compare the prevalence of implementing basic experimental design principles in preclinical studies published in low- and high-impact factor journals.
- To assess the impact of journal impact factor on the quality of experimental design in preclinical research.
Main Methods:
- Randomly selected publications from PubMed and Web of Science (WoS).
- Assessed implementation rates of local control, randomization, and replication using predefined criteria.
- Compared findings between studies published in low- and high-impact factor journals.
Main Results:
- No significant difference in the number of satisfied experimental design criteria between low- and high-impact factor journal publications.
- Studies in high-impact factor journals received significantly more citations (30.5 ± 38.5 vs 2.6 ± 4.1).
- Low-impact factor journals showed less frequent use of pseudo-replication (30% vs 56%) and more frequent randomization (40% vs 5%).
Conclusions:
- A high prevalence of incomplete implementation of basic experimental design principles exists in both low- and high-impact factor journals.
- Studies in high-impact factor journals, despite higher citation rates, carry a similar risk of incorrectness and bias.
- Ensuring robust experimental design is essential across all publication venues to prevent misleading future research.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Data Validation
Key parameters for method validation include:
Statistical Methods for Analyzing Epidemiological Data
Bias in Epidemiological Studies
The Scientific Method in Nursing Process
When using research findings to change practice, one must understand the process used to guide a study. The scientific method is a systematic, step-by-step process that supports the data's validity, reliability, and generalizability. As a result, findings can be...

