Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

2.9K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
2.9K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

714
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
714
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

6.0K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
6.0K
Bonferroni Test01:10

Bonferroni Test

2.6K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.6K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

14.5K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
14.5K
Significance Testing: Overview01:04

Significance Testing: Overview

10.2K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
10.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Robust Bayesian multilevel meta-analysis: Adjusting for publication bias in the presence of dependent effect sizes.

Behavior research methods·2026
Same author

Investigating the replicability of the social and behavioural sciences.

Nature·2026
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same author

Continuous outcome estimation in N-of-1 trials for accelerated decision-making.

Epilepsia·2026
Same author

A tutorial on Bayesian hypothesis testing of correlation coefficients using the BFpack-module in JASP.

Behavior research methods·2025
Same author

Truncating the likelihood allows outlier exclusion without overestimating the evidence in the Bayes factor t test.

Psychological methods·2025

Related Experiment Video

Updated: Apr 29, 2026

Rup (RNA-seq Usability Assessment Pipeline) - Quality Control for Bulk RNA-seq Experiments in Eukaryotes
05:07

Rup (RNA-seq Usability Assessment Pipeline) - Quality Control for Bulk RNA-seq Experiments in Eukaryotes

Published on: November 7, 2025

559

Bayesian tests to quantify the result of a replication attempt.

Josine Verhagen1, Eric-Jan Wagenmakers1

  • 1Department of Psychology, University of Amsterdam.

Journal of Experimental Psychology. General
|May 29, 2014
PubMed
Summary
This summary is machine-generated.

A new Bayesian replication test quantifies replication success or failure by comparing hypotheses of a zero effect size versus an effect consistent with original study findings. This method aids in formally assessing how replication attempts update scientific knowledge.

More Related Videos

Rare Event Detection Using Error-corrected DNA and RNA Sequencing
10:36

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Published on: August 3, 2018

14.6K
Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement
08:06

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement

Published on: January 19, 2017

7.8K

Related Experiment Videos

Last Updated: Apr 29, 2026

Rup (RNA-seq Usability Assessment Pipeline) - Quality Control for Bulk RNA-seq Experiments in Eukaryotes
05:07

Rup (RNA-seq Usability Assessment Pipeline) - Quality Control for Bulk RNA-seq Experiments in Eukaryotes

Published on: November 7, 2025

559
Rare Event Detection Using Error-corrected DNA and RNA Sequencing
10:36

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Published on: August 3, 2018

14.6K
Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement
08:06

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement

Published on: January 19, 2017

7.8K

Area of Science:

  • Empirical Sciences
  • Psychology
  • Biomedical Research

Background:

  • Replication attempts are crucial for scientific validation.
  • Assessing replication success or failure is often ambiguous.
  • Existing methods lack a standardized approach to quantify replication outcomes.

Purpose of the Study:

  • To introduce a novel Bayesian replication test for quantifying replication outcomes.
  • To provide a suite of Bayesian tests for comprehensive analysis of replication studies.
  • To formalize the assessment of how replication impacts scientific knowledge.

Main Methods:

  • Proposed a Bayesian replication test comparing two hypotheses: null (zero effect size) and alternative (effect consistent with original study posterior distribution).
  • Utilized weighted-likelihood ratio to quantify evidence for replication success or failure.
  • Developed additional Bayesian tests for independent conclusions, effect size differences, and pooled results.

Main Results:

  • The weighted-likelihood ratio effectively quantifies evidence for replication outcomes.
  • The suite of Bayesian tests offers a comprehensive framework for analyzing replication data.
  • Demonstrated the application of these tests using three literature examples.

Conclusions:

  • The proposed Bayesian tests provide a robust and formal method for evaluating replication studies.
  • These methods enhance the interpretation of replication results, moving beyond simple success/failure dichotomies.
  • The approach is particularly useful for studies employing t-tests, requiring minimal input data.