Related Experiment Video
Updated: Dec 26, 2025

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases
Published on: October 24, 2019
Can citation metrics predict the true impact of scientific papers?
Rita I Aroeira1, Miguel A R B Castanho1
1Instituto de Medicina Molecular, Faculdade de Medicina da Universidade de Lisboa, Portugal.
Abstract:
Bibliometric quantification is frequently used as metrics for the evaluation of the scientific performance of researchers and institutions. The researchers' merit is usually assessed by the analysis of quantitative parameters such as the number of publications, the impact factor of journals, the total number of citations, or the h-index, although the limitations in translating these indicators into the impact of the outcome of scientific production are a matter of harsh criticism. To assess, based on factual evidences, the validity of traditional bibliometric analyses to conclude on the impact of papers to advance the state of the art, we carried out an innovative methodology on selected publications (test set). This methodology is based on identifying those citations of the test set papers that truly embed the methods, concepts, or hypotheses to build new knowledge and formulate conclusions. The results show that the percentage of citations that reflect the real impact of the papers of the test set has an average value of 12.4% of total citations and is not related to the impact factor of the journal where the test set papers were published. In conclusion, our analysis demonstrates factually, using experimental data, the total failure of using quantitative bulk citation analyses to conclude on the scientific impact of publications. Only a careful analysis of how the work described in papers was embedded on the subsequent work and/or conclusions of others can tell about the real contribution of a published work to the development of new knowledge and advancement of science.
Related Concept Videos
Types of Impact
The coefficient of restitution is a metric for understanding the dynamics of impacts. It quantifies the ratio of relative velocity...
Impact Loading
In cases of elastic deformation,...
Statistical Significance
Outliers and Influential Points
Impact
When particles with different initial velocities collide, they induce deformation by applying equal and opposite impulses. At the point of maximum deformation, the particles move together with...
The Scientific Method

