Significance and importance: some common misapprehensions about statistics

Area of Science:

• Biostatistics
• Scientific Research Methodology

Background:

• Misinterpretations of statistical concepts are prevalent in scientific literature.
• Common errors involve understanding P values, statistical power, and significance.

Purpose of the Study:

• To address widespread misapprehensions regarding fundamental statistical concepts.
• To promote a clearer understanding of P values, statistical significance, and importance.
• To guide researchers in the appropriate application and interpretation of statistical results.

Main Methods:

• Conceptual review of common statistical misinterpretations.
• Focus on commonsense application of simple statistical principles.
• Emphasis on seeking expert statistical advice for complex analyses.

Main Results:

• P values are frequently misunderstood, often misinterpreted as the probability of the null hypothesis being true.
• Insignificant results do not necessarily imply the absence of an effect; statistical power is crucial for interpretation.
• Statistical significance should not be conflated with practical or clinical importance.

Conclusions:

• Clarifying these statistical concepts is essential for accurate scientific reporting.
• Researchers should prioritize understanding the meaning and limitations of statistical tests.
• Proactive engagement with statistical experts is recommended before commencing research involving complex statistics.