DxGoals: A Software Tool for Determining and Analyzing Clinically Meaningful Classification Accuracy Goals for
Ngoc-Ty Nguyen1, Gene A Pennello2
1U.S. Food and Drug Administration, Center for Biologics Evaluation and Research, Silver Spring, MD, United States.
Background:
To evaluate diagnostic tests for low prevalence conditions, classification accuracy metrics such as sensitivity, specificity, and positive likelihood ratio (PLR) and negative likelihood ratio (NLR) are advantageous because they are prevalence-independent and thus estimable in studies enriched for the condition. However, classification accuracy goals are often chosen without a clear understanding of whether they are clinically meaningful. Pennello (2021) proposed a risk stratification framework for determining classification accuracy goals. A software application is needed to determine the goals and provide data analysis.
Methods:
We introduce DxGoals, a freely available, R-Shiny software application for determining, visualizing, and analyzing classification accuracy goals for diagnostic tests. Given prevalence p for the target condition and specification that a test's positive and negative predictive values PPVand NPV=1-cNPV should satisfy PPV>PPV* and cNPV
Results:
We illustrate DxGoals on tests for penicillin allergy, ovarian cancer, and cervical cancer. The inputs cNPV*,p, and PPV* were informed by clinical management guidelines.
Conclusions:
DxGoals facilitates determination, visualization, and analysis of clinically meaningful standalone and comparative classification accuracy goals. It is a potentially useful tool for diagnostic test evaluation.
Related Concept Videos
Receiver Operating Characteristic Plot
Statistical Software for Data Analysis and Clinical Trials
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
Statgraphics


