Supplementing tests of statistical significance: variation accounted for. Tutorial

Area of Science:

• Statistics
• Research Methodology

Background:

• Significance testing is a common statistical tool.
• Limitations exist in traditional significance testing.

Purpose of the Study:

• To review limitations of statistical significance tests.
• To introduce measures of variation accounted for as a supplement.
• To provide computational details and interpretation cautions.

Main Methods:

• Literature review of statistical significance test limitations.
• Explanation of measures of variation accounted for (e.g., effect size).
• Presentation of computation methods for researchers.

Main Results:

• Statistical significance testing alone can be insufficient.
• Measures of variation accounted for offer additional insight.
• Understanding these measures enhances research interpretation.

Conclusions:

• Supplementing significance tests with variation measures improves statistical analysis.
• Researchers should be aware of interpretation cautions.
• This approach benefits both producers and consumers of research.