Related Experiment Video
Updated: Feb 15, 2026

Use of Three-Dimensional Imaging Reconstruction Software as a Training Tool for Cranial Vena Cava Venipuncture in the Ferret
Published on: July 15, 2025
Use as directed? A comparison of software tools intended to check rigor and transparency of published work
Peter Eckmann1, Adrian Barnett2, Alexandra Bannach-Brown3
1Department of Computer Science and Engineering, UC San Diego, La Jolla, California, United States of America.
Abstract:
The causes of the reproducibility crisis include lack of standardization and transparency in scientific reporting. Checklists such as ARRIVE and CONSORT seek to improve transparency, but they are not always followed by authors and peer review often fails to identify missing items. To address these issues, there are several automated tools that have been designed to check different rigor criteria. We have conducted a broad comparison of 11 automated tools across 9 different rigor criteria from the ScreenIT group. We found some criteria, including detecting open data, where the combination of tools showed a clear winner, a tool which performed much better than other tools. In other cases, including detection of inclusion and exclusion criteria, the combination of tools exceeded the performance of any one tool. We also identified key areas where tool developers should focus their effort to make their tool maximally useful. We conclude with a set of insights and recommendations for stakeholders in the development of rigor and transparency detection tools. The code and data for the study is available at https://github.com/PeterEckmann1/tool-comparison.
More Related Videos
04:59Author Spotlight: Developing a Disposable Dosator for Preclinical Testing of Dry Powder Inhalers in Small Animal Models
Published on: August 18, 2023
09:46Direct Comparison of Hyperspectral Stimulated Raman Scattering and Coherent Anti-Stokes Raman Scattering Microscopy for Chemical Imaging
Published on: April 28, 2022
Related Concept Videos
Protein Folding Quality Check in the RER
The Sense of Self: Reflected Self-Appraisal and Social Comparison
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Evolutionary Relationships through Genome Comparisons
Comparison Between Electrical And Gravitational Forces
Since both are inverse square law forces, the distance gets canceled when the ratio of the two forces is considered. Instead, the ratio of the electrical and gravitational forces depends on...
Comparison between RL and RC circuits