A science impact framework to measure impact beyond journal metrics

Area of Science:

• Public Health Science
• Research Impact Measurement

Background:

• Measuring the impact of public health science on health outcomes is challenging due to time lags and multiple contributing factors.
• Attributing credit for health outcomes to specific scientific efforts is often problematic.

Purpose of the Study:

• To introduce a novel Science Impact Framework (SIF) for tracing and linking public health science to impactful events and actions.
• To provide a flexible framework for measuring scientific impact beyond traditional journal metrics, focusing on real-time effects.

Main Methods:

• The Science Impact Framework (SIF) is modeled on the Institute of Medicine's (IOM) Degrees of Impact Thermometer but with expanded scope and a non-incremental, non-chronological approach.
• SIF recognizes five domains of influence: disseminating science, creating awareness, catalyzing action, effecting change, and shaping the future.
• The framework allows for prospective and retrospective measurement of impact for various scientific efforts, linking events using known indicators.

Main Results:

• The SIF offers a unique focus on real-time effects, acknowledging the complexity and time-intensive nature of measuring ultimate health outcomes.
• It provides a flexible approach adaptable to diverse scientific initiatives, from large-scale programs to individual publications.
• Linking events within the SIF framework facilitates storytelling and acknowledges contributions across the chain of impact.

Conclusions:

• The Science Impact Framework (SIF) provides a robust method for assessing the real-world impact of public health science.
• It enables clear communication of scientific value to diverse stakeholders, including scientists, policymakers, and the public.
• SIF enhances the ability to understand and demonstrate the influence of scientific endeavors on health outcomes.