How to Critically Appraise and Interpret Systematic Reviews and Meta-Analyses of Diagnostic Accuracy: A User Guide

Robert A Frank1, Jean-Paul Salameh1, Nayaar Islam1

  • 1From the Department of Radiology, University of Ottawa, The Ottawa Hospital Civic Campus, 1053 Carling Ave, Room c159, Ottawa, ON, Canada K1Y 4E9 (R.A.F., M.D.F.M.); Faculty of Health Sciences, Queen's University, Kingston, Ontario, Canada (J.P.S.); Clinical Epidemiology Program, Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Canada (N.I., M.H.M., H.D., S.E., B.H.); Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands (B.Y.); Evidence-Based Practice Center, Mayo Clinic, Rochester, Minn (M.H.M.); Department of Medicine, Division of Nephrology and Hypertension, University of Kansas Medical Center, Kansas City, Mo (R.M.); Department of Epidemiology and Data Science, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands (M.L., P.M.B.); Amsterdam Public Health, Amsterdam, the Netherlands (P.M.B.); Institute of Applied Health Research, University of Birmingham, Birmingham, UK (Y.T.); NIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, UK (Y.T.); Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK (P.W.); Department of Radiology, NYU Langone Health, New York, NY (S.K.K.); and Centre for Clinical Epidemiology, Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Canada (B.L.).

Radiology
|March 14, 2023
PubMed
Summary

This guide helps clinicians appraise diagnostic accuracy systematic reviews. It outlines steps to assess review credibility and diagnostic test performance for patient care decisions.

Related Concept Videos

Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
558
Documentation of Nursing Diagnosis01:10

Documentation of Nursing Diagnosis

The nurse documents nursing diagnoses and enters them into the patient record. The identified patient's nursing diagnosis is either written out with a plan of care or entered into the electronic health record.
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
1.3K
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
292
Critical Thinking II01:25

Critical Thinking II

Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
2.9K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
242
Critical Thinking I01:24

Critical Thinking I

Critical thinking helps decision-making and allows nurses to recognize barriers to success and find solutions to possible issues. It helps to brainstorm and implement ideas to achieve goals. Critical thinking helps acknowledge and state workflow inefficiencies while improving management techniques. Nurses understand the value of critical thinking and look for fellow nurses with critical thinking skills to upgrade their professional standards. Critical thinking can advance a nurse's career...
3.4K