A Dunnett-Type Test and Its Sample Size Calculation for Comparing K ROC Curves with a Control
1Department of Biostatistics and Bioinformatics, Duke University, Durham, NC 27705, USA.
Diagnostics (Basel, Switzerland)
|August 29, 2024
Summary
This study introduces a new statistical method for comparing multiple diagnostic biomarkers against a control. The method includes a sample size calculation to ensure accurate testing for biomarker performance in disease diagnosis.
Area of Science:
- Biostatistics
- Medical Diagnostics
- Biomarker Discovery
Background:
- Diagnostic biomarkers are crucial for distinguishing between malignant and benign conditions.
- Evaluating continuous biomarkers involves assessing their performance using the Area Under the Curve (AUC) of the receiver operating characteristic curve.
- Comparing multiple experimental biomarkers against a control introduces multiplicity issues.
Purpose of the Study:
- To propose a non-parametric statistical testing procedure for comparing K experimental biomarkers against a single control.
- To develop a sample size calculation method for this comparison, accounting for multiplicity.
- To evaluate the performance of the proposed method through simulations.
Main Methods:
- A novel non-parametric statistical test is developed to compare K experimental biomarkers with a control.
- A sample size formula is derived, incorporating AUC values, correlation coefficients, disease prevalence, type I error rate, and statistical power.
- Simulations are used to assess the accuracy of the type I error rate control and the proposed sample size calculation.
Main Results:
- The proposed statistical test accurately controls the overall type I error rate.
- The sample size calculation method effectively maintains the specified statistical power.
- The method provides a robust approach for biomarker comparison in diagnostic studies.
Conclusions:
- The developed statistical procedure offers a reliable method for comparing multiple diagnostic biomarkers against a control.
- The sample size calculation ensures adequate power for detecting significant differences.
- This work contributes to the rigorous evaluation of diagnostic biomarkers.
Related Concept Videos
Receiver Operating Characteristic Plot
104
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
104
Bonferroni Test
2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
McNemar's Test
180
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
180
One-Way ANOVA: Unequal Sample Sizes
5.7K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.7K
The Mantel-Cox Log-Rank Test
334
The Mantel-Cox log-rank test is a widely used statistical method for comparing the survival distributions of two groups. It tests whether a statistically significant difference exists in survival times between the groups without assuming a specific distribution for the survival data, making it a non-parametric test. This flexibility makes the log-rank test particularly valuable in medical research and other fields where the timing of an event, such as death or disease recurrence, is of...
334
Wilcoxon Signed-Ranks Test for Median of Single Population
112
The Wilcoxon signed-rank test for the median of a single population is a nonparametric test used to evaluate whether the median of a population differs from a specified value. Unlike parametric tests, it does not require data to follow a normal distribution, making it suitable for non-normal or small samples. The test begins by calculating the difference (d) between each observation and the hypothesized median. The absolute values of these differences are ranked in ascending order, with ties...
112


