Jove
Visualize
Contact Us

Related Concept Videos

Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

11.5K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
11.5K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

18.8K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
18.8K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

711
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
711
Random and Systematic Errors01:20

Random and Systematic Errors

968
968
Random and Systematic Errors01:20

Random and Systematic Errors

16.3K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
16.3K
Statistical Significance01:37

Statistical Significance

24.6K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
24.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same author

Huge meta-research project puts claims in social-science papers to the test.

Nature·2026
Same author

Correcting for publication bias in a meta-analysis with the p-uniform* method.

Psychonomic bulletin & review·2026
Same author

Assessing Questionable and Responsible Research Practices in Psychology Master's Theses.

Behavioral sciences (Basel, Switzerland)·2026
Same author

<i>Who</i> Cares What Other People Think? A Longitudinal Investigation of the Role of Autonomy-Connectedness in Self-Esteem Change Trajectories and Instability.

Cognitive therapy and research·2025
Same author

Adoption of Personal Health Records in Dutch Hospitals and Private Medical Clinics: Longitudinal Study.

Journal of medical Internet research·2025
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Apr 19, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.5K

Statistical Reporting Errors and Collaboration on Statistical Analyses in Psychological Science.

Coosje L S Veldkamp1, Michèle B Nuijten1, Linda Dominguez-Alvarez2

  • 1Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, The Netherlands.

Plos One
|December 11, 2014
PubMed
Summary

Psychologists rarely co-pilot statistical analyses, despite data sharing being common. A high percentage of studies contain statistical reporting errors, but co-piloting did not reduce these errors.

More Related Videos

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

8.2K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.5K

Related Experiment Videos

Last Updated: Apr 19, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.5K
Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

8.2K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.5K

Area of Science:

  • Psychology
  • Scientific Research Methods
  • Statistical Analysis

Background:

  • Statistical analysis is prone to errors, necessitating robust verification practices.
  • Co-piloting, or collaborative data analysis and reporting, is proposed as a best practice to enhance accuracy.
  • The extent of co-piloting and its impact on statistical accuracy in psychology research remains understudied.

Purpose of the Study:

  • To investigate the prevalence of co-piloting in statistical analysis and data reporting among psychology researchers.
  • To assess the frequency of statistical reporting errors in published psychology articles.
  • To examine the relationship between co-piloting practices and the occurrence of statistical reporting errors.

Main Methods:

  • Surveyed authors of 697 articles from six top psychology journals regarding collaboration in data analysis and reporting.
  • Collected responses from 49.6% of the surveyed articles.
  • Employed an automated procedure to detect inconsistencies in p-values, test statistics, and degrees of freedom.

Main Results:

  • Co-piloting on statistical analysis and reporting is uncommon in psychology.
  • Data sharing among co-authors is reasonably standard but not universal.
  • 63% of articles had inconsistent p-values; 20% had errors potentially affecting significance decisions.
  • The probability of any given p-value being inconsistent exceeded 10%.

Conclusions:

  • Current co-piloting practices in psychology are insufficient to prevent widespread statistical reporting errors.
  • While data sharing is common, it does not appear to mitigate reporting inaccuracies.
  • Further interventions are needed to improve the reliability of statistical reporting in psychological research.