Related Experiment Video
Updated: Jul 4, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
A quantitative assessment of a methodology for collaborative specification and evaluation of clinical guidelines
Erez Shalom1, Yuval Shahar, Meirav Taieb-Maimon
1Medical Informatics Research Center, Department of Information Systems Engineering, Ben-Gurion University of Negev, Beer-Sheva 84105, Israel. erezsh@bgu.ac.il
Abstract:
We introduce a three-phase, nine-step methodology for specification of clinical guidelines (GLs) by expert physicians, clinical editors, and knowledge engineers and for quantitative evaluation of the specification's quality. We applied this methodology to a particular framework for incremental GL structuring (mark-up) and to GLs in three clinical domains. A gold-standard mark-up was created, including 196 plans and subplans, and 326 instances of ontological knowledge roles (KRs). A completeness measure of the acquired knowledge revealed that 97% of the plans and 91% of the KR instances of the GLs were recreated by the clinical editors. A correctness measure often revealed high variability within clinical editor pairs structuring each GL, but for all GLs and clinical editors the specification quality was significantly higher than random (p<0.01). Procedural KRs were more difficult to mark-up than declarative KRs. We conclude that given an ontology-specific consensus, clinical editors with mark-up training can structure GL knowledge with high completeness, whereas the main demand for correct structuring is training in the ontology's semantics.
Related Concept Videos
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic illness...
Clinically Relevant Drug Product Specifications: Methods of Establishment
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Nursing Evaluation
Section...
Clinical Trials
There are four phases in a clinical trial. A phase one...