Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient
Jan Klosa1, Noah Simon2, Pål Olof Westermark1
1Institute of Genetics and Biometry, Leibniz Institute for Farm Animal Biology, 18196, Dummerstorf, Germany.
The seagull R package offers a fast and efficient implementation of penalized linear regression methods, including lasso, group lasso, and sparse-group lasso. It accurately predicts biological age from DNA methylation data, outperforming existing packages in speed.
Area of Science:
- Life Sciences
- Bioinformatics
- Computational Biology
Background:
- High-dimensional linear models are common in biological data analysis.
- Penalization methods like lasso are crucial for handling multicollinearity.
- Existing methods can be computationally intensive.
Purpose of the Study:
- To introduce a fast and numerically efficient R package, seagull, for penalized linear regression.
- To implement lasso, group lasso, and sparse-group lasso operators.
- To enable the computation of complete regularization paths.
Main Methods:
- Proximal gradient descent for efficient computation of penalized operators.
- Warm starts for fast grid search of penalty parameters.
- Backtracking line search for determining step size in iterations.
Main Results:
- The seagull package demonstrates comparable accuracy to the SGL package in predicting biological age from methylation data (R² > 0.99).
- seagull computes solutions significantly faster than SGL.
- The package supports feature weighting, enhancing its flexibility.
Conclusions:
- seagull provides a comprehensive suite of lasso variants, including lasso, group lasso, sparse-group lasso, and IPF-lasso.
- It offers a computationally efficient and flexible tool for high-dimensional linear modeling in biological sciences.
- The package facilitates precise biological age prediction from DNA methylation data.
More Related Videos
07:34A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
Published on: March 25, 2014
07:11ARL Spectral Fitting as an Application to Augment Spectral Data via Franck-Condon Lineshape Analysis and Color Analysis
Published on: August 19, 2021
Related Concept Videos
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Regression Toward the Mean
Calibration Curves: Linear Least Squares
For data that follow a straight line, the standard method for fitting is the linear...
Quadratic Models
Linear Approximation in Time Domain
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
Multiple Regression
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
