Reporting instructions significantly impact false positive rates when reading chest radiographs
John W Robinson1, Patrick C Brennan2, Claudia Mello-Thoms2
1Medical Image Optimisation and Perception Group, Discipline of Medical Radiation Sciences, Faculty of Health Sciences, The University of Sydney, 75 East Street, Lidcombe, 2141, NSW, Australia. john.robinsonmrs@sydney.edu.au.
Objectives:
To determine the impact of specific reporting tasks on the performance of radiologists when reading chest radiographs.
Methods:
Ten experienced radiologists read a set of 40 postero-anterior (PA) chest radiographs: 21 nodule free and 19 with a proven solitary nodule. There were two reporting conditions: an unframed task (UFT) to report any abnormality and a framed task (FT) reporting only lung nodule/s. Jackknife free-response operating characteristic (JAFROC) figure of merit (FOM), specificity, location sensitivity and number of true positive (TP), false positive (FP), true negative (TN) and false negative (FN) decisions were used for analysis.
Results:
JAFROC FOM for tasks showed a significant reduction in performance for framed tasks (P = 0.006) and an associated decrease in specificity (P = 0.011) but no alteration to the location sensitivity score. There was a significant increase in number of FP decisions made during framed versus unframed tasks for nodule-containing (P = 0.005) and nodule-free (P = 0.011) chest radiographs. No significant differences in TP were recorded.
Conclusions:
Radiologists report more FP decisions when given specific reporting instructions to search for nodules on chest radiographs. The relevance of clinical history supplied to radiologists is called into question and may induce a negative effect.
Key Points:
• Framed reporting tasks increases false positive rates when searching for pulmonary nodules • False positive results were observed in both nodule-containing and nodule-free cases • Radiologist's decision-making may be influenced by clinical history in thoracic imaging.
More Related Videos
06:16Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
Published on: August 9, 2024
08:05Lung CT Segmentation to Identify Consolidations and Ground Glass Areas for Quantitative Assesment of SARS-CoV Pneumonia
Published on: December 19, 2020
Related Concept Videos
01:30Radiological Investigation I: X-ray and CT
01:13Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
01:25Errors occurring during blood pressure monitoring
Several factors...
01:30Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
01:20Imaging Studies for Cardiovascular System III: X-Ray
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
01:28Imaging Studies for Cardiovascular System V: CT