Related Experiment Video
Updated: Dec 24, 2025
09:35
A Protocol for Using Gene Set Enrichment Analysis to Identify the Appropriate Animal Model for Translational Research
Published on: August 16, 2017
18.2K
When "facts" are not facts: what does p value really mean, and how does it deceive us?
Caiyun Liao1, Andrew L Speirs2, Sierra Goldsmith3
1Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN, USA. cliao5@uthsc.edu.
Journal of Assisted Reproduction and Genetics
|April 8, 2020
Summary
A JAMA study incorrectly linked frozen embryo transfer to increased childhood cancer risk. This highlights common statistical misinterpretations in medical research, potentially harming patient care.
Area of Science:
- Reproductive Medicine
- Biostatistics
- Pediatric Oncology
Background:
- A recent study in JAMA suggested a doubled risk of childhood cancer following frozen embryo transfer.
- This finding has significant implications for assisted reproductive technologies and patient counseling.
Purpose of the Study:
- To critically evaluate the statistical methodologies used in the JAMA paper.
- To address the potential misinterpretation of p-values and "statistical significance" in medical literature.
Main Methods:
- Analysis of the statistical tests employed in the original JAMA publication.
- Review of the interpretation of p-values and significance thresholds.
Main Results:
- The JAMA paper demonstrated an erroneous application of statistical tests.
- Misinterpretation of p-values contributed to misleading conclusions about frozen embryo transfer risks.
Conclusions:
- The study underscores the prevalence of flawed statistical analysis in high-impact medical journals.
- Misleading "statistical significance" can create harmful myths for patients and clinicians.
Keywords:
Childhood cancerFrozen embryo transferMultiple comparisonScientific inferenceStatistical significanceMore Related Videos
Related Concept Videos
01:10P-value
8.4K
P-value is one of the most crucial concepts in statistics.
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
8.4K
01:09Decision Making: P-value Method
6.7K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
6.7K
01:50Statistical Significance
20.9K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.9K
01:24Testing a Claim about Population Proportion
3.8K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.8K
01:04Significance Testing: Overview
10.9K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
10.9K
01:14Decision Making: Traditional Method
5.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.0K