Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

2.0K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.0K
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

142
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
142
Types of Hypothesis Testing01:11

Types of Hypothesis Testing

26.5K
There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
26.5K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

207
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
207
Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

4.2K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
4.2K
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Relationship between Altmetric scores and traditional metrics in the anesthesiology literature.

Canadian journal of anaesthesia = Journal canadien d'anesthesie·2026
Same author

Extreme weather events and postoperative outcomes: is it possible to understand what we have not measured?

Canadian journal of anaesthesia = Journal canadien d'anesthesie·2026
Same author

Association of preoperative beta-blocker interruption on postoperative morbidity and mortality: a historical cohort study.

Canadian journal of anaesthesia = Journal canadien d'anesthesie·2025
Same author

Surgical health policy 2025-35: strengthening essential services for tomorrow's needs.

Lancet (London, England)·2025
Same author

Association between preoperative proton pump inhibitor use and postoperative infectious and renal complications following major elective surgery.

Canadian journal of surgery. Journal canadien de chirurgie·2025
Same author

In Response to: Reflections on ECPR in New Zealand: Past, Present and Future.

Emergency medicine Australasia : EMA·2025

Related Experiment Video

Updated: Jul 15, 2025

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types
12:39

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types

Published on: December 10, 2012

11.4K

Interpreting frequentist hypothesis tests: insights from Bayesian inference.

David Sidebotham1,2,3, C Jake Barlow4, Janet Martin5,6

  • 1Department of Anaesthesia and the Cardiothoracic and Vascular Intensive Care Unit, Auckland City Hospital, Auckland, New Zealand. dsidebotham@adhb.govt.nz.

Canadian Journal of Anaesthesia = Journal Canadien D'Anesthesie
|October 4, 2023
PubMed
Summary
This summary is machine-generated.

Statistical significance in medical trials (P values) can be misleading. This study explains why, and proposes using Bayesian metrics alongside P values to improve clinical decisions and treatment adoption.

Keywords:
Bayes factorBayes’ theoremfalse negative riskfalse positive riskrandomized trials

More Related Videos

Creating Objects and Object Categories for Studying Perception and Perceptual Learning
14:38

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

11.9K
A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

13.7K

Related Experiment Videos

Last Updated: Jul 15, 2025

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types
12:39

A Novel Bayesian Change-point Algorithm for Genome-wide Analysis of Diverse ChIPseq Data Types

Published on: December 10, 2012

11.4K
Creating Objects and Object Categories for Studying Perception and Perceptual Learning
14:38

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

11.9K
A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

13.7K

Area of Science:

  • Medical Statistics
  • Clinical Trial Analysis
  • Bayesian Inference

Background:

  • Randomized controlled trials (RCTs) are crucial for evaluating medical interventions.
  • Traditional frequentist hypothesis testing using P values and confidence intervals can lead to incorrect assumptions about treatment effectiveness.
  • Misinterpretations of statistical significance may result in discarding effective treatments or adopting ineffective ones.

Purpose of the Study:

  • To explore the relationship between real treatment effects and statistical significance declarations (P values and confidence intervals) in RCTs.
  • To explain the limitations of frequentist hypothesis testing and introduce Bayesian inference as an alternative.
  • To propose an interim solution for the "significance problem" by integrating simplified Bayesian metrics with traditional frequentist reporting.

Main Methods:

  • Analysis of the relationship between real treatment effects and statistical significance using P values and confidence intervals.
  • Introduction to Bayesian inference and its advantages over frequentist methods.
  • Calculation of Bayesian metrics (e.g., Bayes factor, false positive risk) for four major multicenter trials.

Main Results:

  • Declarations of statistical significance (P ≤ 0.05) do not guarantee treatment effectiveness, with a notable chance of ineffectiveness.
  • Conversely, non-significant results (P > 0.05) do not always imply a lack of treatment effect.
  • Bayesian posterior distributions offer a more robust approach to statistical inference compared to frequentist methods.

Conclusions:

  • Frequentist hypothesis testing remains standard in medical research, despite its limitations.
  • Proposed interim solution involves reporting simplified Bayesian metrics alongside P values and confidence intervals.
  • This approach aims to enhance clinical decision-making by providing a more accurate assessment of treatment effects, reducing the risk of errors in treatment adoption or rejection.