Related Experiment Video
Updated: Mar 13, 2026

Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
Development and Validation of a Standardized Tool for Prioritization of Information Sources
Holy Akwar1, Harold Kloeze2, Shamir Mukhi1
1Canadian Network for Public Health Intelligence, National Microbiology Laboratory, Winnipeg, Manitoba.
A new tool effectively prioritizes information sources for early disease detection, showing substantial agreement among raters. This aids in selecting reliable data for public health surveillance systems.
Area of Science:
- Public Health
- Infectious Disease Surveillance
- Information Science
Background:
- Effective early disease detection relies on timely access to accurate information.
- Prioritizing numerous information sources is crucial for efficient surveillance.
- Existing methods for source prioritization may lack standardization.
Purpose of the Study:
- To validate a standardized tool for prioritizing information sources for early disease detection.
- To assess the utility and effectiveness of this novel prioritization tool.
Main Methods:
- A standardized tool was developed with input from public health experts.
- Ten raters evaluated ten information sources using the tool.
- Inter-rater reliability was calculated using Fleiss Kappa and Kendall's Coefficient of Concordance.
Main Results:
- The tool assigned composite scores to ten information sources, with ProMed scoring highest (91%).
- Substantial agreement was found among raters, with a Fleiss Kappa of 50.7% for all sources and 72.5% for a subset.
- This agreement validates the tool's effectiveness in prioritizing information.
Conclusions:
- The study successfully validated a standardized tool for prioritizing information sources.
- The tool identified five suitable sources for the KIWI system in the CEZD-IIR project for improved infectious disease surveillance.
- The tool is generalizable for prioritizing multiple information sources in various contexts.
Related Concept Videos
Nursing Assessment
The nurse collects all aspects of the patient's health in the initial assessment, establishing priorities for ongoing focused assessments...
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Pre-Procedural Guidelines for Assessing Blood Pressure
Nursing Interventions II: Selecting and Classifying the Nursing Interventions
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Methods of Documentation IV: Focus Charting
It typically involves three columns for recording information:

