Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Analysis: Overview01:11

Statistical Analysis: Overview

11.7K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
11.7K
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.8K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.8K
Restarting Stalled Replication Forks02:37

Restarting Stalled Replication Forks

6.1K
DNA replication is initiated at sites containing predefined DNA sequences known as origins of replication. DNA is unwound at these sites by the minichromosome maintenance (MCM) helicase and other factors such as Cdc45 and the associated GINS complex.The unwound single strands are protected by replication protein A (RPA) until DNA polymerase starts synthesizing DNA at the 5’ end of the strand in the same direction as the replication fork. To prevent the replication fork from falling apart,...
6.1K
Statistical Methods for Analyzing Epidemiological Data01:25

Statistical Methods for Analyzing Epidemiological Data

709
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
709
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

300
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
300
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

4.6K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
4.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Workflows to automate covariate-adaptive randomization in REDCap via data entry triggers.

JAMIA open·2025
Same author

Inner Cell Mass Grade and Earlier Blastulation Are Associated with Pregnancy Outcomes in Euploid Embryos.

Reproductive sciences (Thousand Oaks, Calif.)·2025
Same author

The Impact of the COVID-19 Pandemic on Depression, Anxiety, and Stress among Black Women with Depressive Symptoms at a Federally Qualified Health Center.

Journal of racial and ethnic health disparities·2024
Same author

An Explainable Artificial Intelligence Software Tool for Weight Management Experts (PRIMO): Mixed Methods Study.

Journal of medical Internet research·2023
Same author

On the Accuracy of Replication Failure Rates.

Multivariate behavioral research·2023
Same author

The process of replication target selection in psychology: what to consider?

Royal Society open science·2023
Same journal

Bayesian evaluation for latent variable models: A tutorial on computing information criteria and bayes factors with the r package bleval.

Psychological methods·2026
Same journal

A stochastic block prior for clustering in graphical models.

Psychological methods·2026
Same journal

Three-level vector autoregressive models.

Psychological methods·2026
Same journal

Scaling cognitive modeling to big data: A deep learning approach to studying individual differences in evidence accumulation model parameters.

Psychological methods·2026
Same journal

Best practices in multilevel modeling for within-cluster group comparisons: An evaluation of coding strategies reflecting group composition and heterogeneity.

Psychological methods·2026
Same journal

A unified framework for psychometrics in experimental psychology: The standardized generalized hierarchical factor model.

Psychological methods·2026
See all related articles

Related Experiment Video

Updated: Nov 16, 2025

A Cost Effective and Adaptable Scratch Migration Assay
08:59

A Cost Effective and Adaptable Scratch Migration Assay

Published on: June 30, 2020

5.8K

Reconsidering statistical methods for assessing replication.

J M Schauer1, L V Hedges2

  • 1Institute for Policy Research, Northwestern University.

Psychological Methods
|February 22, 2021
PubMed
Summary
This summary is machine-generated.

Replication studies in psychology often yield unreliable conclusions due to varied analysis methods. This research reveals a high probability of errors, potentially misclassifying up to 80% of replication findings.

More Related Videos

Methods of Soil Resampling to Monitor Changes in the Chemical Concentrations of Forest Soils
09:16

Methods of Soil Resampling to Monitor Changes in the Chemical Concentrations of Forest Soils

Published on: November 25, 2016

17.1K
The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
11:58

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

9.8K

Related Experiment Videos

Last Updated: Nov 16, 2025

A Cost Effective and Adaptable Scratch Migration Assay
08:59

A Cost Effective and Adaptable Scratch Migration Assay

Published on: June 30, 2020

5.8K
Methods of Soil Resampling to Monitor Changes in the Chemical Concentrations of Forest Soils
09:16

Methods of Soil Resampling to Monitor Changes in the Chemical Concentrations of Forest Soils

Published on: November 25, 2016

17.1K
The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
11:58

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

9.8K

Area of Science:

  • Psychology
  • Research Methodology
  • Scientific Reproducibility

Background:

  • Recent empirical evaluations in psychology indicate a low rate of successful replication attempts.
  • The analysis of replication studies is not standardized, with multiple methods applied to the same data.
  • This lack of consensus challenges the interpretation of replication research findings.

Purpose of the Study:

  • To describe common methods used in replication research and their implied operational definitions of replication.
  • To compute the probabilities of false failure and false success in replication studies.
  • To assess the error rates in the application of these methods to existing literature.

Main Methods:

  • Description of prevalent statistical analysis techniques employed in psychological replication research.
  • Calculation of the probability of Type II errors (false failure) and Type I errors (false success).
  • Application of these probability calculations to empirical data from published replication studies.

Main Results:

  • The probabilities of false failure and false success determinations are frequently high, often exceeding 50%.
  • These error rates are, in many cases, uncontrolled and not widely understood.
  • Analysis indicates a substantial probability (up to 75-80%) that reported conclusions about replication are incorrect.

Conclusions:

  • Current methods for analyzing replication studies in psychology are prone to significant error.
  • The interpretation of replication success or failure is highly sensitive to the chosen analysis method.
  • There is a critical need for standardized, well-understood methods to ensure the reliability of replication research.