Related Experiment Video
Updated: May 28, 2026

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images (SDM-PSI)
Published on: November 27, 2019
Is meta-analysis the platinum standard of evidence?
1Department of Philosophy, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093-0119, USA. jstegeng@ucsd.edu
Abstract:
An astonishing volume and diversity of evidence is available for many hypotheses in the biomedical and social sciences. Some of this evidence-usually from randomized controlled trials (RCTs)-is amalgamated by meta-analysis. Despite the ongoing debate regarding whether or not RCTs are the 'gold-standard' of evidence, it is usually meta-analysis which is considered the best source of evidence: meta-analysis is thought by many to be the platinum standard of evidence. However, I argue that meta-analysis falls far short of that standard. Different meta-analyses of the same evidence can reach contradictory conclusions. Meta-analysis fails to provide objective grounds for intersubjective assessments of hypotheses because numerous decisions must be made when performing a meta-analysis which allow wide latitude for subjective idiosyncrasies to influence its outcome. I end by suggesting that an older tradition of evidence in medicine-the plurality of reasoning strategies appealed to by the epidemiologist Sir Bradford Hill-is a superior strategy for assessing a large volume and diversity of evidence.
Related Concept Videos
Statistical Significance
Statistical Software for Data Analysis and Clinical Trials
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Introduction to Epidemiology
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
