Related Experiment Video
Updated: Jul 10, 2026

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases
Published on: October 24, 2019
Reliability of journal impact factor rankings
1Biostatistics Unit, Centre for Epidemiology & Biostatistics, University of Leeds, Leeds, UK. d.c.greenwood@leeds.ac.uk
Background:
Journal impact factors and their ranks are used widely by journals, researchers, and research assessment exercises.
Methods:
Based on citations to journals in research and experimental medicine in 2005, Bayesian Markov chain Monte Carlo methods were used to estimate the uncertainty associated with these journal performance indicators.
Results:
Intervals representing plausible ranges of values for journal impact factor ranks indicated that most journals cannot be ranked with great precision. Only the top and bottom few journals could place any confidence in their rank position. Intervals were wider and overlapping for most journals.
Conclusion:
Decisions placed on journal impact factors are potentially misleading where the uncertainty associated with the measure is ignored. This article proposes that caution should be exercised in the interpretation of journal impact factors and their ranks, and specifically that a measure of uncertainty should be routinely presented alongside the point estimate.
Related Concept Videos
Reliability and Validity
Journal Bearings
To better understand the concept of journal bearings, consider a rope winch with dry or...
Confidence Coefficient
Impact Loading
In cases of elastic deformation,...
Uncertainty: Confidence Intervals
Confidence Intervals
A confidence...