Related Experiment Video
Updated: Jan 4, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
EFFECT size or statistical significance, where to put your money
1University of Alabama at Birmingham, School of Public Health, Department of Biostatistics, 1665 University Boulevard, Ryals Public Health Building, Room 327, Birmingham, AL United States.
Abstract:
There is continuing controversy over the excessive reliance on p-values. This paper elaborates on the use of p-values, points out their utility and reminds that there is no single measure that is a universal measure of the value of a study. All measures have their warts and moles, but each has utility. This paper discusses not only p-values but important measures of effect, effect sizes. The over or under interpretation of various measures is cautioned. The p-value is just a function of the summary statistic chosen for the outcome, the sample size and indicates a binary decision about the hypothesis. Using p-values are still OK, but should be coupled with other measures, such as effect sizes. A p-value alone won't get you through an ethics review board, no matter what its value, and it shouldn't get you through a journal review either.
More Related Videos
Related Concept Videos
Statistical Significance
Significance Testing: Overview
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Sample Size Calculation
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...

