Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Random and Systematic Errors01:20

Random and Systematic Errors

16.3K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
16.3K
Random and Systematic Errors01:20

Random and Systematic Errors

977
977
Regression Toward the Mean01:52

Regression Toward the Mean

7.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
7.3K
Uncertainty in Measurement: Accuracy and Precision03:37

Uncertainty in Measurement: Accuracy and Precision

114.0K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. 
114.0K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

18.8K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
18.8K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

11.5K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
11.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Oxylipin-mediated metabolic signatures of symbiosis homeostasis and thermal stress in a model sea anemone.

The ISME journal·2026
Same author

The perceptual average in ensemble representation: Neither perceptual nor an average.

Attention, perception & psychophysics·2025
Same author

Engineered zwitterionic diblock copolymer-siRNA polyplexes provide highly effective treatment of triple-negative breast cancer in a 4T1 murine model.

Advanced functional materials·2025
Same author

Randomized controlled trial of a prenatal focused coparenting consultation for unmarried black fathers and mothers: One-year infant and family outcomes.

Infant mental health journal·2022
Same author

ROC measures of memory accessibility.

Quarterly journal of experimental psychology (2006)·2022
Same author

Modeling mean estimation tasks in within-trial and across-trial contexts.

Attention, perception & psychophysics·2022

Related Experiment Video

Updated: Apr 21, 2026

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement
08:06

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement

Published on: January 19, 2017

8.9K

When more data steer us wrong: replications with the wrong dependent measure perpetuate erroneous conclusions.

Caren M Rotello1, Evan Heit, Chad Dubé

  • 1Department of Psychological and Brain Sciences, University of Massachusetts, Amherst, 135 Hicks Way, Amherst, MA, 01003-9271, USA, caren@psych.umass.edu.

Psychonomic Bulletin & Review
|November 12, 2014
PubMed
Summary

Scientific replication is challenging, but psychological research faces a deeper issue: consistent misinterpretation of reproducible results. This study identifies common errors and proposes solutions like receiver operating characteristic (ROC) curves to improve scientific accuracy.

More Related Videos

Measurement of Specific Mycobacterial Mistranslation Rates with Gain-of-function Reporter Systems
06:18

Measurement of Specific Mycobacterial Mistranslation Rates with Gain-of-function Reporter Systems

Published on: April 26, 2019

6.5K
The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
11:58

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

10.2K

Related Experiment Videos

Last Updated: Apr 21, 2026

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement
08:06

Genome-wide Determination of Mammalian Replication Timing by DNA Content Measurement

Published on: January 19, 2017

8.9K
Measurement of Specific Mycobacterial Mistranslation Rates with Gain-of-function Reporter Systems
06:18

Measurement of Specific Mycobacterial Mistranslation Rates with Gain-of-function Reporter Systems

Published on: April 26, 2019

6.5K
The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
11:58

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

10.2K

Area of Science:

  • Psychological research
  • Cognitive science
  • Behavioral science

Background:

  • The scientific community faces a replication crisis, with psychological research notably affected by difficulties in reproducing findings.
  • Beyond replication issues, a more pervasive problem is the consistent misinterpretation of empirical results that are, in fact, easily and reliably reproduced.

Purpose of the Study:

  • To identify and illustrate fundamental interpretive errors in psychological research stemming from unrecognized incompatibilities.
  • To demonstrate how these errors can occur even with easily replicable findings and persist despite additional data.
  • To propose strategies and tools, such as receiver operating characteristic (ROC) curves, to mitigate these interpretive errors.

Main Methods:

  • Analysis of four well-established "textbook" examples from diverse research areas: eyewitness memory, deductive reasoning, social psychology, and child welfare.
  • Examination of how incompatibilities between dependent measures, analytical tools, and data properties contribute to interpretive errors.
  • Evaluation of the impact of these errors on research efforts and policy recommendations.

Main Results:

  • Identified systematic interpretive errors in psychological research due to unrecognized incompatibilities in methods and data.
  • Demonstrated that these errors are not resolved by simply collecting more data.
  • Highlighted the potential for these errors to lead to flawed research conclusions and misguided policy decisions.

Conclusions:

  • Persistent interpretive errors, rather than just replication difficulties, pose a significant threat to the integrity of psychological science.
  • Implementing specific analytical tools and strategies, such as receiver operating characteristic (ROC) curves, can help reduce the incidence of these errors.
  • Adopting robust methodological and analytical practices is crucial for accurate interpretation of empirical results and sound scientific progress.