Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
Regression Analysis01:11

Regression Analysis

Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Variation01:19

Variation

An important characteristic of any set of data is the variation in the data. In some data sets, the data values are concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. The most common measure of variation, or spread, is the standard deviation, which is the square root of variance.
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
Multiple Regression01:25

Multiple Regression

Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Microsoft Excel: Regression Analysis01:18

Microsoft Excel: Regression Analysis

Regression analysis in Microsoft Excel is a powerful statistical method for examining the relationship between a dependent variable and one or more independent variables. It's used extensively in fields such as economics, biology, and business to predict outcomes, understand relationships, and make data-driven decisions. The most common type is linear regression, which attempts to fit a straight line through the data points to model the relationship between variables.
To perform regression...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Meta-analysis for trend estimation.

Statistics in medicine·2003
Same author

A sensitivity analysis for publication bias in systematic reviews.

Statistical methods in medical research·2001
Same author

Reanalysis of epidemiological evidence on lung cancer and passive smoking.

BMJ (Clinical research ed.)·2000
Same author

Using generalized linear models (GLMs) to model errors in motor performance.

Journal of motor behavior·1991
Same author

Community care: does it reduce the need for psychiatric beds? A comparison of two different styles of service in three hospitals.

The British journal of psychiatry : the journal of mental science·1991
Same author

Record linkage: statistical models for matching computer records.

Journal of the Royal Statistical Society. Series A, (Statistics in Society)·1990

Related Experiment Video

Updated: Jul 20, 2026

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

Using regression models for prediction: shrinkage and regression to the mean

J B Copas1

  • 1Department of Statistics, University of Warwick, Coventry, UK. jbc@stats.warwick.ac.uk

Statistical Methods in Medical Research
|June 1, 1997
PubMed
Summary

Regression to the mean causes future predictions to be closer to the average than expected. This shrinkage effect is significant in small samples or with many predictors, impacting risk assessment models.

Related Experiment Videos

Last Updated: Jul 20, 2026

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

Area of Science:

  • Statistics
  • Biostatistics
  • Epidemiology

Background:

  • Regression models are used for predicting future cases and risk assessment.
  • Regression to the mean is a statistical phenomenon where future values tend to be closer to the mean.

Purpose of the Study:

  • To discuss the implications of regression to the mean in predictive modeling.
  • To study the extent of shrinkage in multiple and logistic regression models.
  • To identify factors influencing shrinkage, such as sample size and number of covariates.

Main Methods:

  • Analysis of fitted regression models, including multiple and logistic regression.
  • Investigation of the relationship between shrinkage and goodness-of-fit statistics.
  • Illustration of predictor shrinkage with practical examples.

Main Results:

  • Shrinkage of predicted values towards the overall mean is a key characteristic of regression models.
  • The degree of shrinkage is linked to goodness-of-fit measures.
  • Shrinkage poses a significant challenge in small sample sizes or when using numerous covariates.

Conclusions:

  • Regression to the mean can lead to over-optimistic predictions, particularly in small datasets or complex models.
  • Understanding and quantifying shrinkage is crucial for accurate risk assessment and diagnostic tools.
  • The study suggests a more general formulation to address shrinkage in regression analysis.