Related Experiment Video
Updated: Aug 6, 2026
09:27
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Interpretation of data from multiple trials: a critical review
1Yale University School of Medicine, New Haven, Connecticut, USA.
Journal of Internal Medicine
|March 1, 1997
Summary
This review details meta-analysis, a method for combining study results. High-quality meta-analysis requires rigorous design and execution to avoid errors, ensuring reliable scientific evidence.
Area of Science:
- Medical Research Methodology
- Biostatistics
- Evidence Synthesis
Background:
- Meta-analysis, a statistical technique for combining results from similar investigations, was first described in 1976.
- The practice has evolved significantly, with thousands of meta-analyses published to date.
- Meta-analyses can be conducted narratively or, more rigorously, using statistical methods.
Purpose of the Study:
- To review the current status and methodology of meta-analysis.
- To present and discuss criteria for designing and executing high-quality meta-analyses.
- To highlight potential pitfalls and the importance of attention to detail in meta-analysis.
Main Methods:
- Review of the evolution and current practices of meta-analysis.
- Detailed discussion of quality criteria, including study selection, bias assessment, and heterogeneity analysis.
- Presentation of critical reviews and examples from hepatology research.
Main Results:
- Meta-analysis has evolved into a complex but powerful tool for evidence synthesis.
- High-quality meta-analysis demands rigorous attention to detail in study selection, quality assessment, and heterogeneity management.
- Improper execution can lead to ambiguous or erroneous conclusions.
Conclusions:
- While conceptually simple, meta-analysis is complex to perform correctly.
- Adherence to stringent methodological criteria is essential for generating reliable and valid results.
- Expertise and careful execution are crucial to harness the full potential of meta-analysis in scientific research.
Related Concept Videos
02:07Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
01:52Regression Toward the Mean
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
01:37Statistical Significance
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
01:24Testing a Claim about Population Proportion
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:13Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
01:16Clinical Trials
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...