Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Types of Hypothesis Testing01:11

Types of Hypothesis Testing

27.0K
There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
27.0K
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

257
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
257
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.3K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.3K
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

3.5K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
3.5K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

376
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
376
Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

4.8K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
4.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Reducing the false discovery rate of preclinical animal research with Bayesian statistical decision criteria.

Statistical methods in medical research·2023
Same author

The Bayesian simulation study (BASIS) framework for simulation studies in statistical and methodological research.

Biometrical journal. Biometrische Zeitschrift·2023
Same author

The evidence interval and the Bayesian evidence value: On a unified theory for Bayesian hypothesis testing and interval estimation.

The British journal of mathematical and statistical psychology·2022
Same author

fbst: An R package for the Full Bayesian Significance Test for testing a sharp null hypothesis against its alternative via the e value.

Behavior research methods·2021
Same author

Bayesian Hodges-Lehmann tests for statistical equivalence in the two-sample setting: Power analysis, type I error rates and equivalence boundary selection in biomedical research.

BMC medical research methodology·2021
Same author

Simulation data for the analysis of Bayesian posterior significance and effect size indices for the two-sample t-test to support reproducible medical research.

BMC research notes·2020

Related Experiment Video

Updated: Oct 18, 2025

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types
12:39

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types

Published on: December 10, 2012

11.4K

How to Choose between Different Bayesian Posterior Indices for Hypothesis Testing in Practice.

Riko Kelter1

  • 1Department of Mathematics, University of Siegen.

Multivariate Behavioral Research
|September 28, 2021
PubMed
Summary

Bayesian data analysis offers solutions to issues in traditional null hypothesis significance testing (NHST). This study compares Bayesian posterior indices, finding two underused candidates with strong theoretical properties for cognitive science research.

Keywords:
Bayes factorBayesian hypothesis testingBayesian posterior indicesMAP-based p-valueROPEe-valueequivalence testingprobability of direction (PD)

More Related Videos

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

11.1K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.2K

Related Experiment Videos

Last Updated: Oct 18, 2025

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types
12:39

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types

Published on: December 10, 2012

11.4K
A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

11.1K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.2K

Area of Science:

  • Cognitive Science
  • Experimental Psychology
  • Statistical Methods

Background:

  • Traditional null hypothesis significance testing (NHST) and p-values present challenges in replication within experimental psychology and cognitive sciences.
  • Bayesian data analysis is proposed as an alternative to address these issues.
  • However, the variety of Bayesian posterior indices complicates practical application and selection.

Purpose of the Study:

  • To compare various Bayesian posterior indices proposed as alternatives to traditional p-values.
  • To discuss the benefits and limitations of these Bayesian indices.
  • To identify suitable Bayesian indices for hypothesis testing in cognitive sciences.

Main Methods:

  • Literature review and comparison of Bayesian posterior indices.
  • Analysis of theoretical properties and practical utility of each index.
  • Evaluation of indices based on study design and research goals.

Main Results:

  • Not all proposed Bayesian alternatives to NHST offer conceptual benefits.
  • The utility of some Bayesian indices is highly dependent on specific study designs and research objectives.
  • At least two Bayesian posterior indices demonstrate appealing theoretical properties.

Conclusions:

  • The selection of Bayesian indices for hypothesis testing requires careful consideration of their theoretical underpinnings and practical applicability.
  • Two specific Bayesian posterior indices are identified as promising yet underutilized in cognitive science research.
  • Further adoption of these indices could enhance the rigor and interpretability of findings in the cognitive sciences.