Related Experiment Video
Updated: Apr 7, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Classes of Multiple Decision Functions Strongly Controlling FWER and FDR.
Edsel A Peña1, Joshua D Habiger2, Wensong Wu3
1Department of Statistics, University of South Carolina, Columbia, SC 29208 USA, Tel.: 803-576-5813, , pena@stat.sc.edu.
New multiple decision functions control family-wise error rate (FWER) or false discovery rate (FDR), potentially improving the missed discovery rate (MDR) compared to the Benjamini-Hochberg procedure, especially for high-dimensional data.
Area of Science:
- Statistics
- Statistical methodology
- Data analysis
Background:
- Multiple decision functions are crucial for controlling error rates in statistical testing.
- Existing methods like the Benjamini-Hochberg (BH) procedure control the false discovery rate (FDR).
- There is a need for methods that optimize Type II error criteria, such as the missed discovery rate (MDR), while controlling Type I error rates.
Purpose of the Study:
- To describe two general classes of multiple decision functions.
- To explore the potential for finding optimal functions that control family-wise error rate (FWER) or false discovery rate (FDR) while minimizing the missed discovery rate (MDR).
- To evaluate the performance of these new functions against established methods.
Main Methods:
- Description of two classes of multiple decision functions.
- Simulation study using gamma-distributed data.
- Comparison of a novel FDR-controlling procedure with the Benjamini-Hochberg (BH) procedure.
Main Results:
- The proposed FDR-controlling procedure demonstrated a gain in missed discovery rate (MDR) compared to the Benjamini-Hochberg (BH) procedure.
- The developed functions offer the possibility of optimizing Type II error control under FWER or FDR constraints.
- Simulation results indicate improved performance in specific data scenarios.
Conclusions:
- The described multiple decision functions provide a framework for enhanced error rate control in multiple testing.
- These methods show potential for improved efficiency in detecting true effects, particularly in high-dimensional datasets.
- The findings suggest broader applicability in statistical analysis, especially for complex data structures.
Related Concept Videos
Types of Errors: Detection and Minimization
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Errors In Hypothesis Tests
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Hazard Rate
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...

