Related Experiment Video
Updated: Mar 15, 2026

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases
Published on: October 24, 2019
Citation Metrics: A Primer on How (Not) to Normalize
John P A Ioannidis1,2,3,4, Kevin Boyack5, Paul F Wouters6
1Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, United States of America.
Normalizing citation metrics is crucial for fairly evaluating research, considering factors like field and publication year. Careful consideration of normalization methods and metric assumptions is essential for accurate appraisal.
Area of Science:
- Bibliometrics
- Research Assessment
- Scientometrics
Background:
- Citation metrics are widely used for research appraisal.
- Normalization is needed to account for variations across fields, publication age, and document types.
- Combining metrics across multiple papers presents additional challenges.
Purpose of the Study:
- To discuss the advantages and disadvantages of different normalization approaches for citation metrics.
- To explore challenges in aggregating citation metrics for evaluating entities like scientists, institutions, and countries.
- To highlight the complexities of attributing credit in multi-authored publications.
Main Methods:
- Discussion of normalization strategies for citation data.
- Analysis of challenges in aggregating citation metrics.
- Review of credit attribution methods in collaborative research.
Main Results:
- Normalization of citation metrics is complex, with various approaches having distinct pros and cons.
- Aggregating citation metrics for broader evaluations introduces significant challenges.
- Attributing credit in multi-authored works requires careful consideration of metric contributions.
Conclusions:
- Normalization is essential but challenging, requiring careful selection of methods.
- Different citation metrics offer complementary insights but rely on underlying assumptions.
- Accurate research appraisal necessitates a nuanced understanding of citation metric calculations and their limitations.
More Related Videos
Related Concept Videos
Ratio Level of Measurement
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
Measures of Central Tendency
Normal Distribution
Measurement: Derived Units
Applications of Normal Distribution
The heights of 15 to 18-year-old males from Chile from 1984 to 1985 followed a normal distribution. The mean height is 172.36...
Percentile

