Jove
Visualize
Contact Us

Related Concept Videos

Multiple Regression01:25

Multiple Regression

3.3K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.3K
Factorial Design02:01

Factorial Design

13.4K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.4K
One-Way ANOVA01:18

One-Way ANOVA

9.5K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
9.5K
Two-Way ANOVA01:17

Two-Way ANOVA

2.8K
The two-way ANOVA is an extension of the one-way ANOVA. It is a statistical test performed on three or more samples categorized by two factors - a row factor and a column factor. Ronald Fischer mentioned it in 1925 in his book 'Statistical Methods for Researchers.'
The two-way ANOVA analysis initially begins by stating the null hypothesis that there is an interaction effect between the two factors of a dataset. This effect can be visualized using line segments formed by joining the...
2.8K
Correlation and Regression00:53

Correlation and Regression

2.6K
In statistics, correlation describes the degree of association between two variables. In the subfield of linear regression, correlation is mathematically expressed by the correlation coefficient, which describes the strength and direction of the relationship between two variables. The coefficient is symbolically represented by 'r' and ranges from -1 to +1. A positive value indicates a positive correlation where the two variables move in the same direction. A negative value suggests a...
2.6K
Regression Analysis01:11

Regression Analysis

6.5K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
6.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Transcriptomic and epigenetic mechanisms controlling cholangiocyte transdifferentiation into hepatocytes.

Journal of hepatology·2025
Same author

IL-9 is a key component of memory TH cell peanut-specific responses from children with peanut allergy.

The Journal of allergy and clinical immunology·2014
Same author

MiRNA recognition with the yasMiR system: the quest for further improvements.

Advances in experimental medicine and biology·2011
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Oct 22, 2025

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
06:48

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Published on: June 25, 2019

9.4K

A Factor Analysis Perspective on Linear Regression in the 'More Predictors than Samples' Case.

Sebastian Ciobanu1, Liviu Ciortuz1

  • 1Faculty of Computer Science, Alexandru Ioan Cuza University of Iaşi, 700506 Iaşi, Romania.

Entropy (Basel, Switzerland)
|August 27, 2021
PubMed
Summary
This summary is machine-generated.

This study introduces a novel factor analysis (FA) approach to address limitations in linear regression (LR) when predictors exceed samples. The method offers a robust alternative for high-dimensional data, yielding closed-form or EM algorithms.

Keywords:
factor analysislinear regressionmissing datamore predictors than samplessemisupervised regression

More Related Videos

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills
06:52

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills

Published on: September 17, 2019

6.5K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.0K

Related Experiment Videos

Last Updated: Oct 22, 2025

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
06:48

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Published on: June 25, 2019

9.4K
Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills
06:52

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills

Published on: September 17, 2019

6.5K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.0K

Area of Science:

  • Machine Learning
  • Statistical Modeling

Background:

  • Linear regression (LR) is a fundamental supervised learning model for regression tasks.
  • Standard LR analytic solutions fail when the number of predictors exceeds the number of samples due to undefined matrix inverses.
  • Existing solutions like Moore-Penrose inverse or L2 regularization address this issue.

Purpose of the Study:

  • To propose an alternative solution to the LR problem using factor analysis (FA), an unsupervised learning model.
  • To leverage FA's density estimation capability for high-dimensional data where LR struggles.
  • To develop supervised, semisupervised, and missing-data extensions of FA linked to LR.

Main Methods:

  • Utilized factor analysis (FA) with a one-dimensional latent space for density estimation.
  • Developed supervised and semisupervised counterparts of FA.
  • Extended the FA model to handle missing data.
  • Proved the equivalence between the proposed FA model and linear regression.
  • Implemented algorithms as closed-form solutions or expectation-maximization (EM) algorithms.

Main Results:

  • The proposed FA-based approach successfully fits Gaussian distributions even when data dimensionality exceeds the number of samples.
  • Equivalence to linear regression was mathematically proven.
  • Experiments demonstrated the efficacy of the supervised, semisupervised, and missing-data extensions.
  • The EM algorithm variant connects to information theory via Kullback-Leibler (KL) divergence or entropy optimization.

Conclusions:

  • The factor analysis framework provides a viable and advantageous alternative to standard linear regression for high-dimensional datasets.
  • The developed extensions offer flexible and robust modeling capabilities for various data scenarios, including missing values.
  • The connection to information theory deepens the understanding of the underlying statistical principles.