Related Experiment Video
Updated: Jul 19, 2025

Author Spotlight: Advancements in Multiplex Detection of Respiratory Viruses
Published on: November 10, 2023
Comparing the prevalence of statistical reporting inconsistencies in COVID-19 preprints and matched controls: a
Robbie C M van Aert1, Michèle B Nuijten1, Anton Olsson-Collentine1
1Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands.
Abstract:
The COVID-19 outbreak has led to an exponential increase of publications and preprints about the virus, its causes, consequences, and possible cures. COVID-19 research has been conducted under high time pressure and has been subject to financial and societal interests. Doing research under such pressure may influence the scrutiny with which researchers perform and write up their studies. Either researchers become more diligent, because of the high-stakes nature of the research, or the time pressure may lead to cutting corners and lower quality output. In this study, we conducted a natural experiment to compare the prevalence of incorrectly reported statistics in a stratified random sample of COVID-19 preprints and a matched sample of non-COVID-19 preprints. Our results show that the overall prevalence of incorrectly reported statistics is 9-10%, but frequentist as well as Bayesian hypothesis tests show no difference in the number of statistical inconsistencies between COVID-19 and non-COVID-19 preprints. In conclusion, the literature suggests that COVID-19 research may on average have more methodological problems than non-COVID-19 research, but our results show that there is no difference in the statistical reporting quality.
More Related Videos
09:26Quantification and Whole Genome Characterization of SARS-CoV-2 RNA in Wastewater and Air Samples
Published on: June 30, 2023
06:55Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Related Concept Videos
Confounding in Epidemiological Studies
Bias in Epidemiological Studies
Statistical Methods for Analyzing Epidemiological Data
Controls in Experiments
Chi-square Analysis
The chi-square test was developed by Pearson in 1990.
The first step of performing a Chi-square analysis is to establish a null hypothesis, which assumes that there is no real...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...