Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

7.8K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.8K
Regression Toward the Mean01:52

Regression Toward the Mean

6.5K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.5K
Outliers and Influential Points01:08

Outliers and Influential Points

4.2K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.2K
Calibration Curves: Linear Least Squares01:20

Calibration Curves: Linear Least Squares

1.8K
A calibration curve is a plot of the instrument's response against a series of known concentrations of a substance. This curve is used to set the instrument response levels, using the substance and its concentrations as standards. Alternatively, or additionally, an equation is fitted to the calibration curve plot and subsequently used to calculate the unknown concentrations of other samples reliably.
For data that follow a straight line, the standard method for fitting is the linear...
1.8K
Multiple Regression01:25

Multiple Regression

3.1K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.1K
Regression Analysis01:11

Regression Analysis

6.0K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
6.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Wavelet Decomposition-Based Genomic Analysis of the Human Electrocardiogram.

medRxiv : the preprint server for health sciences·2026
Same author

Quantifying Anterior Cruciate Ligament Injury Resilience: A Screening and Composite Score Framework.

Orthopaedic journal of sports medicine·2026
Same author

Estimating heterogeneous treatment effects for general responses.

Biometrics·2025
Same author

Using pre-training and interaction modeling for ancestry-specific disease prediction using multiomics data from the UK Biobank.

PloS one·2025
Same author

Annotation-free discovery of disease-relevant cells in single-cell datasets.

Science advances·2025
Same author

A statistical view of column subset selection.

Journal of the Royal Statistical Society. Series B, Statistical methodology·2025
Same journal

Bayesian Model Calibration and Sensitivity Analysis for Oscillating Biological Experiments.

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences·2025
Same journal

Spatiotemporal Interactive Modeling of Event-based Dynamic Networks.

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences·2025
Same journal

Note on the Equivalence of Orthogonalizing EM and Proximal Gradient Descent.

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences·2025
Same journal

Anomaly Detection in Large-Scale Networks With Latent Space Models.

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences·2024
Same journal

Robust Low-rank Tensor Decomposition with the <math></math> Criterion.

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences·2024
Same journal

A Sharper Computational Tool for L<sub>2</sub>E Regression.

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences·2023
See all related articles

Related Experiment Video

Updated: Aug 30, 2025

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data
10:46

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

Published on: December 9, 2015

10.8K

Ridge Regularization: An Essential Concept in Data Science.

Trevor Hastie1

  • 1Department of Statistics, Department of Biomedical Data Science, Stanford University, Stanford, CA.

Technometrics : a Journal of Statistics for the Physical, Chemical, and Engineering Sciences
|August 29, 2022
PubMed
Summary
This summary is machine-generated.

Ridge regularization (ℓ₂ regularization) is a fundamental technique in statistics and machine learning. This overview explores its diverse applications and elegant properties discovered over 40 years of applied statistics research.

Keywords:
Data scienceRetrospectiveRidge regression

More Related Videos

O-cresol Concentration Online Measurement Based On Near Infrared Spectroscopy Via Partial Least Square Regression
06:50

O-cresol Concentration Online Measurement Based On Near Infrared Spectroscopy Via Partial Least Square Regression

Published on: November 8, 2019

6.7K
Trajectory Data Analyses for Pedestrian Space-time Activity Study
16:14

Trajectory Data Analyses for Pedestrian Space-time Activity Study

Published on: February 25, 2013

13.6K

Related Experiment Videos

Last Updated: Aug 30, 2025

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data
10:46

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

Published on: December 9, 2015

10.8K
O-cresol Concentration Online Measurement Based On Near Infrared Spectroscopy Via Partial Least Square Regression
06:50

O-cresol Concentration Online Measurement Based On Near Infrared Spectroscopy Via Partial Least Square Regression

Published on: November 8, 2019

6.7K
Trajectory Data Analyses for Pedestrian Space-time Activity Study
16:14

Trajectory Data Analyses for Pedestrian Space-time Activity Study

Published on: February 25, 2013

13.6K

Area of Science:

  • Statistics
  • Machine Learning
  • Data Science

Background:

  • Ridge regularization, also known as L2 regularization, is a widely used technique.
  • It is a crucial tool for data scientists across various fields.
  • The technique has a long history in applied statistics.

Purpose of the Study:

  • To provide an overview of the magic and beauty of ridge regularization.
  • To collect insights and experiences from 40 years of applied statistics.

Main Methods:

  • Review of L2 regularization principles.
  • Exploration of its applications in statistics and machine learning.
  • Compilation of practical insights from 40 years of research.

Main Results:

  • Demonstration of the essential nature of ridge regularization for data scientists.
  • Highlighting the diverse applicability of L2 regularization.
  • Showcasing the elegance and utility of the technique.

Conclusions:

  • Ridge regularization is an indispensable method in modern data analysis.
  • Mastery of L2 regularization is key for effective data science.
  • The technique offers both theoretical beauty and practical power.