Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
Significance Testing: Overview01:04

Significance Testing: Overview

Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Bonferroni Test01:10

Bonferroni Test

The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Decision Making: P-value Method01:09

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can have a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Legacy effects of four decades of insecticide applications on contemporary riverine benthic macroinvertebrates.

Environmental pollution (Barking, Essex : 1987)·2025
Same author

Legacy DDT and its metabolites in Brook Trout from lakes within forested watersheds treated with aerial applications of insecticides.

PloS one·2025
Same author

Predictable ecological dynamics over incredibly small spatial scales influence early-life phenotypes in a species with temperature-dependent sex determination.

Journal of evolutionary biology·2025
Same author

Weak evidence of density dependent population regulation when using the ability of two simple density dependent models to predict population size.

Scientific reports·2024
Same author

Temporal change in urban fish biodiversity-Gains, losses, and drivers of change.

Ecology and evolution·2024
Same author

Historical pesticide applications for the treatment of eastern spruce budworm infestations in New Brunswick.

Ecology·2023

Related Experiment Video

Updated: May 24, 2026

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition
14:01

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition

Published on: May 22, 2015

Setting an optimal α that minimizes errors in null hypothesis significance tests.

Joseph F Mudge1, Leanne F Baker, Christopher B Edge

  • 1Department of Biology, University of New Brunswick, Saint John, New Brunswick, Canada. joe.mudge@unb.ca

Plos One
|March 6, 2012
PubMed
Summary

Researchers propose an optimal threshold (α) for null hypothesis significance testing to minimize errors, replacing the arbitrary 0.05 standard. This approach enhances scientific confidence and transparency in statistical inferences.

More Related Videos

Optimization of Antigen Preparation for Hemagglutination Inhibition Assay of Newcastle Disease Virus Serology
07:04

Optimization of Antigen Preparation for Hemagglutination Inhibition Assay of Newcastle Disease Virus Serology

Published on: January 24, 2025

The α-test: Rapid Cell-free CD4 Enumeration Using Whole Saliva
11:22

The α-test: Rapid Cell-free CD4 Enumeration Using Whole Saliva

Published on: May 16, 2012

Related Experiment Videos

Last Updated: May 24, 2026

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition
14:01

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition

Published on: May 22, 2015

Optimization of Antigen Preparation for Hemagglutination Inhibition Assay of Newcastle Disease Virus Serology
07:04

Optimization of Antigen Preparation for Hemagglutination Inhibition Assay of Newcastle Disease Virus Serology

Published on: January 24, 2025

The α-test: Rapid Cell-free CD4 Enumeration Using Whole Saliva
11:22

The α-test: Rapid Cell-free CD4 Enumeration Using Whole Saliva

Published on: May 16, 2012

Area of Science:

  • Statistics
  • Scientific Methodology

Background:

  • Null hypothesis significance testing (NHST) is criticized for its arbitrary significance level (α), typically set at 0.05.
  • This fixed threshold can lead to arbitrary decisions regarding effect sizes and Type II errors.

Purpose of the Study:

  • To propose an optimal, data-driven approach for setting the significance threshold (α) in NHST.
  • To minimize the combined probability of Type I and Type II errors for stronger scientific inferences.

Main Methods:

  • Calculating an optimal α that minimizes the average of Type I (α) and Type II (β) error rates at a critical effect size.
  • The method allows for the incorporation of prior probabilities and relative error costs.

Main Results:

  • An optimal α can be determined to minimize both Type I and Type II errors.
  • This approach offers greater transparency regarding assumptions about effect sizes and error costs.

Conclusions:

  • Arbitrary use of α = 0.05 in NHST is scientifically unjustifiable.
  • Determining an optimal α leads to more robust and reliable scientific conclusions.