Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Analysis: Overview01:11

Statistical Analysis: Overview

6.1K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.1K
Uncertainty in Measurement: Accuracy and Precision03:37

Uncertainty in Measurement: Accuracy and Precision

73.4K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. 
73.4K
Variability: Analysis01:11

Variability: Analysis

128
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
128
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

176
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
176
Accuracy and Precision01:52

Accuracy and Precision

8.7K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.  Highly accurate...
8.7K
Random and Systematic Errors01:20

Random and Systematic Errors

10.8K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
10.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Claims about scientific rigour require rigour.

Nature human behaviour·2024
Same author

Subjective evidence evaluation survey for many-analysts studies.

Royal Society open science·2024
Same author

Rigorous exploration in a model-centric science via epistemic iteration.

Journal of applied research in memory and cognition·2024
Same author

There are no shortcuts to theory.

The Behavioral and brain sciences·2024
Same author

The logical structure of experiments lays the foundation for a theory of reproducibility.

Royal Society open science·2023
Same author

The case for formal methodology in scientific reform.

Royal Society open science·2021
Same journal

Research on a Regional Availability Evaluation Model for Road-Area High-Entropy Energy Based on Synergy Factors.

Entropy (Basel, Switzerland)·2026
Same journal

Atmospheric Turbulence Channel Modeling and Performance Analysis of a CO-ZP-OFDM Coherent Optical Communication System for UAV Air-to-Ground Scenarios.

Entropy (Basel, Switzerland)·2026
Same journal

Information Geometry and Asymptotic Theory for SMML Estimators.

Entropy (Basel, Switzerland)·2026
Same journal

Correlation Entropy and Power-Law Kinetics.

Entropy (Basel, Switzerland)·2026
Same journal

Research on the Contagion of Systemic Financial Risk Under the Impact of Climate Risks-From the Perspective of Complex Networks and Machine Learning.

Entropy (Basel, Switzerland)·2026
Same journal

The Statistical-Mechanical Meaning of the Wave Function of Quantum Mechanics.

Entropy (Basel, Switzerland)·2026
See all related articles

Related Experiment Video

Updated: Jun 9, 2025

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement
08:06

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement

Published on: January 19, 2017

8.4K

Statistics in Service of Metascience: Measuring Replication Distance with Reproducibility Rate.

Erkan O Buzbas1, Berna Devezer1,2

  • 1Department of Mathematics and Statistical Science, University of Idaho, Moscow, ID 83844, USA.

Entropy (Basel, Switzerland)
|October 25, 2024
PubMed
Summary
This summary is machine-generated.

Scientific reproducibility is crucial. This study proposes measuring the "replication distance" between studies, viewing reproducibility as a tool, not an inherent property, to improve scientific inference and guide future research.

Keywords:
idealized experimentminimum viable experimentphilosophy of statisticsreplication distancereproducibility ratescientific inference

More Related Videos

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
11:58

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

9.4K
Improving Reproducibility to Meet Minimal Information for Studies of Extracellular Vesicles 2018 Guidelines in Nanoparticle Tracking Analysis
08:52

Improving Reproducibility to Meet Minimal Information for Studies of Extracellular Vesicles 2018 Guidelines in Nanoparticle Tracking Analysis

Published on: November 17, 2021

2.3K

Related Experiment Videos

Last Updated: Jun 9, 2025

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement
08:06

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement

Published on: January 19, 2017

8.4K
The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
11:58

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

9.4K
Improving Reproducibility to Meet Minimal Information for Studies of Extracellular Vesicles 2018 Guidelines in Nanoparticle Tracking Analysis
08:52

Improving Reproducibility to Meet Minimal Information for Studies of Extracellular Vesicles 2018 Guidelines in Nanoparticle Tracking Analysis

Published on: November 17, 2021

2.3K

Area of Science:

  • Philosophy of Statistics
  • Scientific Methodology
  • Research Reproducibility

Background:

  • The scientific community faces a reproducibility crisis, impacting the reliability of research findings.
  • Current discussions on reproducibility often lack a nuanced framework for evaluating replication efforts.
  • Understanding the relationship between study replicability and result reproducibility is essential for robust scientific inference.

Purpose of the Study:

  • To propose a novel framework for measuring the 'replication distance' between scientific studies.
  • To reframe reproducibility not as an intrinsic quality but as a metric for assessing deviations in replications.
  • To enhance the utility of statistical inference in light of challenges in scientific replication.

Main Methods:

  • Conceptual analysis of scientific study specification for statistical inference.
  • Development of a 'replication distance' metric to quantify differences between original studies and their replications.
  • Illustrative simulations using a toy example to demonstrate the proposed framework.

Main Results:

  • Reproducibility is best understood as a tool to measure the distance from an original study, rather than an inherent desirable property.
  • A framework for quantifying 'replication distance' is proposed, addressing challenges in capturing study components.
  • Purposefully planned modifications, rather than direct replications, are suggested as more informative for scientific inquiry.

Conclusions:

  • A quantifiable measure of 'replication distance' is necessary for robustly studying the implications of replicability on scientific inference.
  • The proposed framework aids scientists in identifying 'replication-ready' studies.
  • Likelihood-based and evidential statistical approaches are identified as potentially crucial for developing statistics that better serve scientific practice.