Three common misuses of P values.

Area of Science:

• Statistics
• Scientific Research Methodology

Background:

• The p-value is a standard measure of statistical significance used in hypothesis testing.
• Its role in scientific inference has become disproportionately emphasized.
• Recent concerns have led to calls for re-evaluating its use, including a statement from the American Statistical Association.

Purpose of the Study:

• To review the precise statistical definition of the p-value.
• To identify and discuss common misinterpretations and misuses of p-values in scientific literature.
• To provide guidance for clinicians and researchers on appropriate use and interpretation.

Main Methods:

• Literature review and conceptual analysis of statistical significance.
• Examination of historical context and evolution of p-value usage.
• Synthesis of recommendations from statistical and scientific bodies.

Main Results:

• P-values have a clear mathematical definition but are frequently misinterpreted.
• Over-reliance on p-values can lead to flawed scientific conclusions.
• The American Statistical Association has issued guidance to address these issues.

Conclusions:

• Correct interpretation of p-values is crucial for sound statistical inference.
• Researchers should be aware of the limitations and potential misuses of p-values.
• This review aims to improve the understanding and application of p-values in clinical and scientific research.