Related Experiment Video
Updated: Mar 13, 2026

Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
Development and Validation of a Standardized Tool for Prioritization of Information Sources
Holy Akwar1, Harold Kloeze2, Shamir Mukhi1
1Canadian Network for Public Health Intelligence, National Microbiology Laboratory, Winnipeg, Manitoba.
Purpose:
To validate the utility and effectiveness of a standardized tool for prioritization of information sources for early detection of diseases.
Methods:
The tool was developed with input from diverse public health experts garnered through survey. Ten raters used the tool to evaluate ten information sources and reliability among raters was computed. The Proc mixed procedure with random effect statement and SAS Macros were used to compute multiple raters' Fleiss Kappa agreement and Kendall's Coefficient of Concordance.
Results:
Ten disparate information sources evaluated obtained the following composite scores: ProMed 91%; WAHID 90%; Eurosurv 87%; MediSys 85%; SciDaily 84%; EurekAl 83%; CSHB 78%; GermTrax 75%; Google 74%; and CBC 70%. A Fleiss Kappa agreement of 50.7% was obtained for ten information sources and 72.5% for a sub-set of five sources rated, which is substantial agreement validating the utility and effectiveness of the tool.
Conclusion:
This study validated the utility and effectiveness of a standardized criteria tool developed to prioritize information sources. The new tool was used to identify five information sources suited for use by the KIWI system in the CEZD-IIR project to improve surveillance of infectious diseases. The tool can be generalized to situations when prioritization of numerous information sources is necessary.
Related Concept Videos
Nursing Assessment
The nurse collects all aspects of the patient's health in the initial assessment, establishing priorities for ongoing focused assessments...
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Pre-Procedural Guidelines for Assessing Blood Pressure
Nursing Interventions II: Selecting and Classifying the Nursing Interventions
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Methods of Documentation IV: Focus Charting
It typically involves three columns for recording information:

