Related Experiment Video
Updated: Aug 17, 2026
Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
Published on: August 9, 2024
The interobserver reliability of pretest probability assessment in patients with suspected pulmonary embolism
Marc A Rodger1, Elana Maser, Ian Stiell
1Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada. mrodger@ohri.ca
Introduction:
Pretest probability assessment and objective testing are combined to appropriately manage patients with suspected pulmonary embolism (PE). However, the interobserver reliability of pretest probability assessment has not been investigated. We sought to determine (for patients with suspected PE) the interobserver reliability of pretest probability assessment (by overall impression (gestalt) versus an explicit clinical model).
Materials And Methods:
A prospective cohort study was conducted at an urban university hospital. For patients referred for ventilation and perfusion (V/Q) scanning for suspected PE, structured assessments (11 history and 4 physical examination parameters) were performed by a referring physician and a designated thrombosis physician. The referring and thrombosis physicians also assigned a pretest probability for PE (low, moderate, or high) by gestalt. An explicit seven-point clinical model for suspected PE was later applied to each structured assessment to determine the pretest probability. Assessments were performed independently and prior to diagnostic test results. Interobserver reliability (two rater unweighted Kappa (kappa) statistic) was determined for each parameter on the structured assessment and the pretest probability assessments (gestalt vs. explicit clinical model).
Results:
One hundred and ten patients with suspected PE received duplicate assessments. Historical features demonstrated substantial to almost perfect interobserver reliability (kappa=0.60-0.95). For the physical findings, only heart rate had substantial interobserver reliability (kappa=0.60). Pretest probability assessment was not reliable when using physician's gestalt (kappa=0.33), but produced substantial interobserver reliability using the explicit clinical model (kappa=0.62).
Conclusions:
Given the inadequate interobserver reliability of pretest probability assessment by overall impression (or gestalt), physicians should use explicit clinical models in the diagnostic management of patients with suspected pulmonary embolism.
Related Concept Videos
01:29Pulmonary Embolism II: Diagnostic Studies and Interprofessional Care
01:29Pulmonary Embolism I: Introduction
01:19Pulmonary Embolism I: Introduction
01:27Pulmonary Embolism III: Nursing Management
01:24Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:13Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...