Related Experiment Video
Updated: Jun 14, 2026
Advanced Animal Model of Colorectal Metastasis in Liver: Imaging Techniques and Properties of Metastatic Clones
Published on: November 30, 2016
Understanding Reader Variability: A 25-Radiologist Study on Liver Metastasis Detection at CT.
Scott S Hsieh1, David A Cook1, Akitoshi Inoue1
1From the Departments of Radiology (S.S.H., A.I., H.G., P.S.P., S.L., L.Y., J.L.F., C.H.M., J.G.F.), General Internal Medicine (D.A.C.), Quantitative Health Services-Clinical Trials and Biostatistics (M.P.J.), and Physiology and Biomedical Engineering (D.R.H.), Mayo Clinic Rochester, 200 First St SW, Rochester, MN 55905; and Department of Quantitative Health Services-Clinical Trials and Biostatistics, Mayo Clinic, Jacksonville, Fla (R.E.C.).
Expert abdominal radiologists show superior detection of liver metastases on CT scans, outperforming trainees. Factors like longer interpretation times and use of coronal images improve detection accuracy for hepatic metastases.
Area of Science:
- Radiology
- Medical Imaging
- Diagnostic Accuracy
Background:
- Interreader variability in CT imaging, particularly for detecting hepatic metastases, can lead to misdiagnosis and negatively impact patient care.
- Understanding factors influencing this variability is crucial for improving diagnostic performance in abdominal CT interpretation.
Purpose of the Study:
- To investigate the influence of reader experience, image navigation patterns, and eye gaze time on the detection of liver metastases in contrast-enhanced abdominal CT scans.
- To quantify the impact of these variables on diagnostic accuracy using established performance metrics.
Main Methods:
- A prospective observational trial involving 25 readers (abdominal radiologists, non-abdominal radiologists, trainees) examining 40 contrast-enhanced abdominal CT studies.
- Reader performance was assessed using the area under the jackknife alternative free-response receiver operator characteristic (JAFROC-1) curve and per-metastasis sensitivity.
- Workstation-based tracking of image navigation and eye movements was employed to analyze reader behavior.
Main Results:
- Abdominal radiologists demonstrated significantly higher diagnostic accuracy (area under JAFROC curve) compared to trainees and non-abdominal subspecialists (P = .02 and P = .03, respectively).
- Higher sensitivity was associated with longer interpretation times (P = .003) and increased utilization of coronal images (P < .001).
- A significant proportion of missed liver metastases received at least brief eye gaze (0.5-2.0 seconds).
Conclusions:
- Reader experience, specifically subspecialization in abdominal radiology, is a key determinant of diagnostic performance in detecting liver metastases on CT.
- Image navigation strategies, including interpretation time and the use of specific image planes (coronal), impact detection sensitivity.
- Even brief eye contact with missed lesions suggests potential areas for improving radiologist training and workflow optimization.
More Related Videos
10:32Combined Use of Tail Vein Metastasis Assays and Real-Time In Vivo Imaging to Quantify Breast Cancer Metastatic Colonization and Burden in the Lungs
Published on: December 19, 2019
07:15Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
Published on: August 16, 2020
