Related Experiment Video
Updated: Dec 24, 2025
06:26
Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI
Published on: November 27, 2019
76.5K
"statcheck": Automatically detect statistical reporting inconsistencies to increase reproducibility of meta-analyses
Michèle B Nuijten1, Joshua R Polanin2
1The Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands.
Research Synthesis Methods
|April 11, 2020
Summary
The statcheck tool automatically finds statistical reporting errors in research papers, improving data reproducibility. This helps researchers identify and correct inconsistencies in p-values and other statistical reporting.
Area of Science:
- Psychology
- Medicine
- Social Sciences
Background:
- Statistical reporting inconsistencies, such as mismatched p-values, are prevalent in scientific literature.
- These errors can undermine the reproducibility and evidential value of research findings.
Purpose of the Study:
- To introduce the R package and web app, statcheck, designed for automated detection of statistical reporting inconsistencies.
- To provide an overview of the prevalence and consequences of these inconsistencies.
Main Methods:
- The statcheck tool automatically re-calculates p-values using reported test statistics and degrees of freedom.
- It compares re-calculated p-values with author-reported p-values to identify discrepancies.
Main Results:
- A high prevalence of statistical reporting inconsistencies has been previously identified.
- The statcheck tool can effectively identify these inconsistencies in primary studies and meta-analyses.
Conclusions:
- The statcheck tool aids researchers in detecting and correcting statistical reporting errors.
- Implementing statcheck can enhance the reliability of published research and supports calls for improved statistical reporting standards.
More Related Videos
Related Concept Videos
01:11Statistical Analysis: Overview
13.9K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
13.9K
01:15Systematic Error: Methodological and Sampling Errors
8.3K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
8.3K
01:25Statistical Methods for Analyzing Epidemiological Data
819
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
819
01:12Statistical Software for Data Analysis and Clinical Trials
1.3K
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...
1.3K
01:50Statistical Significance
20.9K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.9K
01:14Identifying Statistically Significant Differences: The F-Test
2.9K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
2.9K