Related Experiment Video
Updated: May 24, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
A new impact assessment method to evaluate knowledge resources
Pierre Pluye1, Roland M Grad, Randolph Stephenson
1Department of Social Studies of Medicine, McGill University, 3647 Peel Street, Montreal, QC, Canada, H3A 1X1.
Rationale:
Methods to systematically measure the impact of knowledge resources on health professionals would enhance evaluation of these resources in the real world.
Objective:
To propose a new impact assessment method.
Background:
We demonstrated the feasibility of combining a 4-level scale with Computerized Ecological Momentary Assessment (CEMA) for efficiently measuring the impact of a knowledge resource.
Method:
We critically reviewed the world literature regarding the impact of clinical information-retrieval technology on trainees and doctors, and retained 26 papers for qualitative content analysis.
Findings:
Of those, 21 use a nominal scale (yes/no), none systematically measures the impact of searches for information outside of a laboratory setting, and none uses an ordinal scale. The literature supports the proposed levels of impact, and suggests a fifth level.
Conclusion:
A new impact assessment method is proposed, which combines a 5-level revised scale and CEMA.
Related Concept Videos
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Types of Impact
The coefficient of restitution is a metric for understanding the dynamics of impacts. It quantifies the ratio of relative velocity...
Impact: Problem Solving
By designating the launch point as the origin and utilizing kinematic equations, the vertical component of the projectile's velocity at the point of impact is...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Metacognition
Methods to Assess Microbial Communities
