Related Experiment Video
Updated: Mar 20, 2026

07:35
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
8.1K
The use of vector bootstrapping to improve variable selection precision in Lasso models.
Summary
Nesting cross-validation within bootstrapping improves Lasso variable selection precision, especially for small effect sizes in genetic data analysis. This enhanced method offers greater reliability than standard approaches.
Area of Science:
- Statistical Genetics
- Bioinformatics
- Computational Biology
Background:
- The Lasso (Least Absolute Shrinkage and Selection Operator) is a key shrinkage regression technique for variable selection in statistical genetics.
- K-fold cross-validation is commonly employed for fitting Lasso models, often supplemented by bootstrap confidence intervals to enhance selection precision.
Purpose of the Study:
- To systematically investigate the impact of nesting cross-validation within bootstrapping on Lasso variable selection precision (VSP).
- To compare the precision of nested cross-validation with standard Lasso methods and software defaults.
Main Methods:
- Simulation studies using genomic data under polygenic and typical Genome-Wide Association Study (GWAS) effect size models.
- Comparison of Lasso VSP with and without nested cross-validation, alongside bootstrapping and default software settings.
- Empirical data analysis using SNPs and SNP-SNP interactions from a GWAS of borderline personality symptoms.
Main Results:
- Nested cross-validation demonstrated superior variable selection precision at small effect sizes.
- No significant advantage of nesting was observed at larger effect sizes.
- The default Lasso approach selected low-reliability SNPs and interactions, which were excluded by the bootstrapping method in the empirical example.
Conclusions:
- Nesting cross-validation within bootstrapping offers enhanced precision for Lasso variable selection, particularly in scenarios with small effect sizes.
- The proposed nested approach provides more reliable SNP and interaction selection compared to default Lasso methods, as evidenced in empirical GWAS data.
Related Concept Videos
Bootstrapping
909
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
909
Truncation in Survival Analysis
681
Truncation in survival analysis refers to the exclusion of individuals or events from the dataset based on specific criteria related to the time of the event. This exclusion can happen in two primary forms: left truncation and right truncation.
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
681
Multiple Regression
4.3K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
4.3K
Regression Analysis
8.8K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
8.8K
Quantifying and Rejecting Outliers: The Grubbs Test
4.4K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.4K
Prediction Intervals
3.5K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
3.5K