Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Beyond statistical inference: a decision theory for science.

Peter R Killeen1

  • 1Department of Psychology, Arizona State University, Box 1104, Tempe, AZ 85287-1104, USA. killeen@asu.edu

Psychonomic Bulletin & Review
|January 5, 2007
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Twiddling Bits.

Perspectives on behavior science·2026
Same author

Agency.

The Journal of general psychology·2024
Same author

Hyperbolae.

Journal of the experimental analysis of behavior·2024
Same author

From data through discount rates to the area under the curve.

Journal of the experimental analysis of behavior·2023
Same author

Theory of reinforcement schedules.

Journal of the experimental analysis of behavior·2023
Same author

Discounting and the portfolio of desires.

Psychological review·2023
Same journal

Mind wandering during first- and foreign-language reading.

Psychonomic bulletin & review·2026
Same journal

Lexical word processing is unaffected by rapid invisible frequency tagging in reading: Evidence from eye movements.

Psychonomic bulletin & review·2026
Same journal

Anxiety modulates voluntary attentional orienting to emotional gaze cues: Eye movements for pro- and anti-saccades.

Psychonomic bulletin & review·2026
Same journal

Faster key-press responses to front vowels than back vowels when matching heard vowels with represented vowels.

Psychonomic bulletin & review·2026
Same journal

Testing the interleaving effect without response bias: A forced-choice reevaluation of Kornell and Bjork (2008).

Psychonomic bulletin & review·2026
Same journal

The impact of social interaction on abstract concepts.

Psychonomic bulletin & review·2026
See all related articles

Null hypothesis significance testing fails to ground scientific decisions. A new decision theory integrates effect replicability and size for a more logical scientific merit index.

Area of Science:

  • Statistics
  • Decision Theory
  • Scientific Methodology

Background:

  • Traditional null hypothesis significance testing (NHST) does not provide probabilities for null or alternative hypotheses, limiting its logical grounding for scientific decisions.
  • NHST prioritizes effect replicability over magnitude, treating them as a special case where false positive costs outweigh true positive value.
  • Existing methods fail to fully integrate key factors like effect size and replicability for robust scientific evaluation.

Purpose of the Study:

  • To propose a novel decision theory for scientific research that logically grounds decision-making.
  • To develop a framework that integrates both the probability of effect replication and effect size into a utility function.
  • To offer a more realistic and comprehensive approach to evaluating scientific findings beyond traditional significance testing.

Related Experiment Videos

Main Methods:

  • Developed a decision theory calculating expected utility based on effect replicability probability and a utility function of effect size.
  • Incorporated opportunity cost into the analysis.
  • Demonstrated consistency with alternative effect size measures (e.g., r², information transmission) and Bayesian model selection criteria.

Main Results:

  • The proposed theory provides a single index of merit by integrating replicability and effect size.
  • Significance tests are identified as a special case within this broader decision framework.
  • An alternative, functionally equivalent formulation is presented, offering transparency and ease of computation.

Conclusions:

  • The proposed decision theory offers a more logical and comprehensive approach to scientific decision-making than traditional significance testing.
  • Integrating effect replicability and size provides a more accurate assessment of scientific merit.
  • The framework is flexible, consistent with existing measures, and computationally accessible.