Related Experiment Video
Updated: Dec 6, 2025

Author Spotlight: Biological Standardization to Ensure Reproducibility and Harmonization in Research
Published on: August 4, 2023
New Author Guidelines in Statistical Reporting: Embracing an Era Beyond p < .05
Samantha L Johnson1, Whitley J Stone2, Jennifer A Bunn3
1Department of Health and Human Performance, Middle Tennessee State University, Murfreesboro, TN, USA.
Researchers should report p-values transparently, moving beyond "statistical significance." New guidelines emphasize raw p-values, effect sizes, and power analyses for better research evaluation.
Area of Science:
- Statistics in quantitative research
- Scientific reporting standards
- Exercise science research
Background:
- The traditional reliance on p-values for statistical significance creates bias and discourages the reporting of non-significant findings.
- A dichotomous pass-fail system based on the 0.05 threshold has led to the suppression of valuable research data.
- This practice hinders the comprehensive understanding and advancement of scientific knowledge.
Discussion:
- The International Journal of Exercise Science is adopting new reporting guidelines to address statistical reform.
- These guidelines aim to move away from 'statistically significant' or 'not significant' declarations.
- Emphasis is placed on transparent reporting of raw p-values and effect magnitudes.
Key Insights:
- All p-values must be reported in their raw, continuous form.
- Measures of effect magnitude are required alongside all p-values.
- Statistical power analyses (a-priori or post-hoc) must accompany reported findings.
Outlook:
- The journal seeks to foster greater transparency in scientific reporting.
- This initiative encourages a more critical and thoughtful evaluation of research findings.
- The goal is to improve the overall quality and interpretability of quantitative research in exercise science.
Related Concept Videos
Statistical Significance
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Chi-square Analysis
The chi-square test was developed by Pearson in 1990.
The first step of performing a Chi-square analysis is to establish a null hypothesis, which assumes that there is no real...

