How to Use and Report on p-values

Area of Science:

• Statistics in quantitative research
• Health professions education research

Background:

• The p-value and its "P < 0.05" threshold are traditional measures of statistical significance.
• Concerns exist regarding p-values misleading findings when practical significance and test suitability are ignored.

Purpose of the Study:

• To provide guidance on the appropriate use of p-values in health professions education research.
• To address the controversy surrounding p-value interpretation and reporting.

Main Methods:

• Overview of the ongoing debate on p-value usage and definition.
• Highlighting common pitfalls in p-value interpretation and application.
• Outlining recommendations for effective statistical reporting.

Main Results:

• The American Statistical Association and leading journals challenge the overreliance on p-values.
• Common pitfalls include misinterpretation, overemphasis, and false dichotomization of results.
• Recommendations include reporting effect sizes, confidence intervals, and conducting sensitivity analyses.

Conclusions:

• Researchers should move towards a more nuanced interpretation of p-values.
• Effective statistical reporting requires considering factors beyond the p-value threshold.
• Adopting recommended practices enhances the informativeness of research findings.