Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Effect sizes and p values: what should be reported and what should be replicated?

A G Greenwald1, R Gonzalez, R J Harris

  • 1Department of Psychology, University of Washington, Seattle 98195-1525, USA. agg@u.washington.edu

Psychophysiology
|March 1, 1996
PubMed
Summary

Null hypothesis testing (NHT) persists in behavioral science due to its dichotomous outcomes and p-value interpretation. Addressing NHT flaws requires focusing on hypothesis importance over p-values for robust findings.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Relationship between 24-Hour Ambulatory Blood Pressure and Cognitive Function in Healthy Elderly People.

Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition·2014
Same author

The prevention and treatment of postoperative lymphedema of the arm.

Annals of surgery·2010
Same author

The first use of chloroform in surgery.

British medical bulletin·2010
Same author

Leiden and Edinburgh; a medical partnership.

British medical bulletin·2010
Same author

Arabian medicine.

Health horizon·2010
Same author

The search for a philosophy of medicine.

Lancet (London, England)·2010

Area of Science:

  • Behavioral Science
  • Statistical Methodology
  • Research Practices

Background:

  • Null hypothesis testing (NHT) remains prevalent in behavioral science despite numerous critiques.
  • Existing criticisms often focus on the limitations and potential misinterpretations of NHT practices.

Purpose of the Study:

  • To identify and explain the virtues that contribute to the continued extensive use of NHT.
  • To propose methods for mitigating the most criticized flaws of NHT in research reporting.

Main Methods:

  • Critical analysis of existing literature on null hypothesis testing.
  • Identification of inherent advantages of NHT, such as dichotomous hypothesis evaluation and p-value interpretation.
  • Proposal of revised reporting standards emphasizing hypothesis importance and detailed descriptive statistics.

Related Experiment Videos

Main Results:

  • NHT's dichotomous (yes/no) hypothesis evaluation provides a clear decision framework.
  • The p-value offers a quantifiable index for confidence in rejecting a null hypothesis.
  • Flaws of NHT can be mitigated by prioritizing hypothesis significance over p-values and avoiding over-reliance on p ≈ .05.

Conclusions:

  • The perceived virtues of NHT, including clear decision-making and quantifiable results, explain its persistence.
  • Researchers should prioritize the importance of hypotheses and report findings with sufficient detail for meta-analysis.
  • Treating p ≈ .05 as insufficient evidence for replicability is crucial for advancing scientific rigor.