What Lies Within: Superscripting References to Reveal Research Trends

Area of Science:

• Bibliometrics
• Scholarly Communication
• Research Evaluation

Background:

• Current citation metrics (e.g., citation counts) are flawed, conflating popularity with precision by not distinguishing between confirmatory and contradictory findings.
• Evaluating scholarly contributions based solely on the number of citations overlooks the nature and context of these citations.

Purpose of the Study:

• To propose a novel citation and indexing procedure that enhances the interpretation of scholarly contributions.
• To integrate research trend information with minimal burden on researchers and consumers.
• To offer a more precise method for evaluating the impact and context of research.

Main Methods:

• Introducing a superscripted categorization system for citations within reference lists.
• Defining six categories: Consistent, Replicated, Inconsistent, Failed to replicate, Theory, and Methodology (CRIF-TM).
• Proposing an online indexing service for summarizing and updating CRIF-TM data.

Main Results:

• The proposed CRIF-TM system allows for nuanced understanding of how a cited work relates to the current research.
• Demonstrates a method for unobtrusively presenting these superscripts in reference lists.
• Outlines how the data can be summarized and updated by an online service.

Conclusions:

• The proposed citation and indexing procedure offers a more precise and informative method for evaluating scholarly work.
• This system addresses the limitations of traditional citation counts by incorporating the nature of citations.
• Anticipated benefits include improved research discoverability and a clearer understanding of research trends, though implementation challenges exist.