Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The p-value fallacy and how to avoid it.

Peter Dixon1

  • 1Department of Psychology, University of Alberta, Edmonton. cjep@ualberta.ca

Canadian Journal of Experimental Psychology = Revue Canadienne De Psychologie Experimentale
|November 5, 2003
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Genetically Estimated Ancestry and the Risk of Pre-Eclampsia: A Multiethnic Case-Control Study.

JACC. Advances·2025
Same author

Clinical Outcomes of Salvage Microsurgical Resection after Radiation Therapy for Sporadic Vestibular Schwannomas.

Journal of neurological surgery. Part B, Skull base·2025
Same author

Audiometric Outcomes of Auditory Brainstem Implantation during Vestibular Schwannoma Resection in NF2 Patients.

Journal of neurological surgery. Part B, Skull base·2025
Same author

Text-based and memory-based metrics of cognitive coupling.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2024
Same author

A nomogram to predict long-term facial nerve function after vestibular schwannoma resection: a contemporary multi-institutional study.

Journal of neurosurgery·2024
Same author

Gene mutations as a non-invasive measure of adult cochlear implant performance: Variable outcomes in patients with select TMPRSS3 mutations.

PloS one·2023
Same journal

The costs and benefits of mind-wandering: 13 Years on.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Can computational sentiment analysis classify autobiographical memories? Comparing VADER and TextBlob.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Development of enumeration processes for kindergarten children: Evidence from eye-tracking data.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Differential sensitivity to outcome valence reveals two classes of shift behaviour related to exploitation and exploration.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Effects of valence and list composition on memory predictions, performance, and beliefs.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
Same journal

Differential response to cognitive stimulation in moderate versus moderately severe Alzheimer's disease.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2026
See all related articles

The p-value fallacy in null hypothesis significance testing can misrepresent experimental results. Likelihood ratios offer a graded evidence approach for better data interpretation.

Area of Science:

  • Statistics
  • Psychology
  • Scientific Methodology

Background:

  • Null hypothesis significance testing (NHST) is widely used in research.
  • The common reliance on a p-value threshold (e.g., 0.05) leads to the 'p-value fallacy'.
  • This dichotomous classification of results as 'significant' or 'not significant' can distort evidence interpretation.

Purpose of the Study:

  • To highlight the limitations of p-value based significance testing.
  • To propose an alternative analytical technique using likelihood ratios.
  • To advocate for a 'graded evidence' principle in data interpretation.

Main Methods:

  • Critique of the p-value fallacy in NHST.
  • Introduction and illustration of likelihood ratio calculations.

Related Experiment Videos

  • Comparison of likelihood ratios with traditional significance testing.

    • Main Results:

    • Similar data patterns can yield different significance outcomes, and vice versa.
    • A focus on significant/nonsignificant effects can misrepresent findings.
    • Likelihood ratios provide a more nuanced assessment of competing interpretations.

    Conclusions:

    • The p-value fallacy can lead to misinterpretations of experimental evidence.
    • Likelihood ratios offer a superior method for evaluating competing hypotheses.
    • Adopting a graded evidence approach ensures similar data yields similar evidential support.