Related Experiment Video
Updated: Nov 30, 2025

RNA-seq Analysis of Transcriptomes in Thrombin-treated and Control Human Pulmonary Microvascular Endothelial Cells
Published on: February 13, 2013
The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods
Joe Menke1, Martijn Roelandse2, Burak Ozyurt3
1Center for Research in Biological Systems, UCSD, SciCrunch Inc, La Jolla, CA 92093, USA.
Abstract:
The reproducibility crisis is a multifaceted problem involving ingrained practices within the scientific community. Fortunately, some causes are addressed by the author's adherence to rigor and reproducibility criteria, implemented via checklists at various journals. We developed an automated tool (SciScore) that evaluates research articles based on their adherence to key rigor criteria, including NIH criteria and RRIDs, at an unprecedented scale. We show that despite steady improvements, less than half of the scoring criteria, such as blinding or power analysis, are routinely addressed by authors; digging deeper, we examined the influence of specific checklists on average scores. The average score for a journal in a given year was named the Rigor and Transparency Index (RTI), a new journal quality metric. We compared the RTI with the Journal Impact Factor and found there was no correlation. The RTI can potentially serve as a proxy for methodological quality.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
The Scientific Method
The Scientific Method
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
The Scientific Method

