Related Experiment Video
Updated: Oct 24, 2025
E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
Reliability of Dutch Obstetric Telephone Triage
Bernice Engeltjes1,2, Ageeth Rosman2, Loes C M Bertens3
1Athena Institute for Transdisciplinary Research, Faculty of Science, VU University, Amsterdam, the Netherlands.
Background:
Safety and efficiency of emergency care can be optimized with a triage system which uses urgency to prioritize care. The Dutch Obstetric Telephone Triage System (DOTTS) was developed to provide a basis for assessing urgency of unplanned obstetric care requests by telephone. Reliability and validity are important components in evaluating such (obstetric) triage systems.
Objective:
To determine the reliability of Dutch Obstetric Telephone Triage, by calculating the inter-rater and intra-rater reliability.
Methods:
To evaluate the urgency levels of DOTTS by testing inter-rater and intra-rater reliability, 90 vignettes of possible requests were developed. Nineteen participants, from hospitals where DOTTS had been implemented, rated in two rounds a set of ten vignettes. The five urgency levels and five presenting symptoms had an equal spread and had to be entered in accordance with DOTTS per vignette. Urgency levels were dichotomized into high urgency and intermediate urgency. Inter-rater reliability was rated as degree of agreement between two different participants with the same vignette. Intra-rater reliability was rated as agreement by the same participants at different moments in time. The degree of inter-rater and intra-rater reliability was tested using weighted Cohen's Kappa and ICC.
Results:
The agreement of urgency level between participants in accordance with predefined urgency level per vignette was 90.5% (95% CI 87.5-93.6) [335 of 370]. Agreement of urgency level between participants was 88.5% (95% CI 84.9-93.0) [177 of 200] and 84.9% (95% CI 78.3-91.4) after re-rating [101 of 119]. Inter-rater reliability of DOTTS expressed as Cohen's Kappa was 0.77 and as ICC 0.87; intra-rater reliability of DOTTS expressed as Cohen's Kappa was 0.70 and as ICC 0.82.
Conclusion:
Inter-rater and intra-rater reliability of DOTTS showed substantial correlation, and is comparable to other studies. Therefore, DOTTS is considered reliable.
Related Concept Videos
01:26Types of Reports III: Telephone and Verbal Reports
Here's an overview of each type:
Telephone Orders
01:26Endoscopic Studies II: Thoracocentesis
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
01:14SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
01:23Assessment of blood pressure in brachial artery(two-step method)
01:28Special considerations while measuring blood pressure
Monitoring Both Arms:
Monitoring BP in both arms during the initial assessment is advisable, as the systolic value may differ by five to ten mm Hg between arms. For subsequent BP assessments, use the arm with the higher reading.