Related Experiment Video
Updated: Mar 28, 2026

Iterative Development of an Innovative Smartphone-Based Dietary Assessment Tool: Traqq
Published on: March 19, 2021
Health system guidance appraisal--concept evaluation and usability testing.
Denis E Ako-Arrey1, Melissa C Brouwers2, John N Lavis3
1McMaster University, Juravinski Hospital Site, G Wing, 2nd Floor, Room 207, 711 Concession Street, Hamilton, Ontario, L8V 1C3, Canada. akoarrde@mcmaster.ca.
A new appraisal tool, AGREE-HS, was developed to improve health system guidance (HSG) quality. This tool systematically guides the development, appraisal, and reporting of HSG for better health system decisions.
Area of Science:
- Health Systems Research
- Guideline Development and Evaluation
- Health Policy and Management
Background:
- Health system guidance (HSG) is crucial for addressing health system challenges but lacks standardized methods for development, appraisal, and reporting.
- Previous research identified 30 candidate criteria for evaluating HSG quality.
- This study aimed to evaluate these criteria, develop a draft HSG appraisal tool, and test its usability.
Purpose of the Study:
- To evaluate the importance of 30 candidate criteria for health system guidance (HSG).
- To design a draft appraisal tool for HSG.
- To test the usability of the developed HSG appraisal tool.
Main Methods:
- A two-step survey process was employed.
- Step 1 involved rating 30 concepts for appropriateness, relevance, and priority in health system decisions and HSG.
- Step 2 involved participants appraising HSG documents using a draft tool and providing feedback.
Main Results:
- High response rates (82% in Step 1, 74% in Step 2) and universally favorable concept ratings were observed.
- Participants reached a consensus on the need for a high-quality tool to guide HSG development, appraisal, and reporting.
- The beta version of the HSG appraisal tool, refined through qualitative feedback, was found to be easy to understand and apply, with high agreement on its usability for development (85%), appraisal (92%), and reporting (81%).
Conclusions:
- The Appraisal of Guidelines for Research and Evaluation for Health Systems (AGREE-HS) version 1.0, comprising 32 items across 4 domains, was generated.
- AGREE-HS defines expectations for HSG.
- The tool facilitates informed decision-making for policymakers regarding health system delivery, financial, and governance arrangements.
Related Concept Videos
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Assessment of the Gastrointestinal System I: Subjective Data
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Assessment of the Gastrointestinal System II: Health Perception Pattern
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Methods Of Healthcare Delivery System
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is...
Documentation in Long-Term and Home Healthcare Setting
Long-Term Care Facilities

