Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Residual Plots

Residual Plots

A residual plot is a statistical representation of data used to analyze correlation and regression results. It helps verify the requirements for drawing specific conclusions about correlation and regression. To obtain the residual plot, first, the residual for each data value is calculated, which is simply the vertical distance between the observed and the predicted value obtained from the regression equation.
When the residual values are plotted against the variable x, it is called a residual...

Residuals and Least-Squares Property

Residuals and Least-Squares Property

The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...

Survival Tree

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...

Generalization, Discrimination, and Extinction

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

Variation

Variation

An important characteristic of any set of data is the variation in the data. In some data sets, the data values are concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. The most common measure of variation, or spread, is the standard deviation, which is the square root of variance.
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...

Multiple Regression

Multiple Regression

Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective.

IEEE transactions on pattern analysis and machine intelligence·2026

Same author

Holistic Invariant Retracing for Distortion-Resilient Multi-Modal Learning in Spatial Transcriptomics.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

Same author

Demonstration of efficient predictive surrogates for large-scale quantum processors.

Nature communications·2026

Same author

A DeepSeek-powered AI system for automated chest radiograph interpretation in clinical practice.

Nature communications·2026

Same author

NoisePO: Efficient Semantic Noise Generation and Ranking for Diffusion-Based Text-to-Image Synthesis.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

Same author

Stability and Generalization for Distributed SGDA.

IEEE transactions on pattern analysis and machine intelligence·2026

Same journal

ASSR-Net: Anisotropic Structure-Aware and Spectrally Recalibrated Network for Hyperspectral Image Fusion.

IEEE transactions on neural networks and learning systems·2026

Same journal

PIMPC-GNN: Physics-Informed Multiphase Consensus Learning for Enhancing Imbalanced Node Classification in Graph Neural Networks.

IEEE transactions on neural networks and learning systems·2026

Same journal

Quantum Rényi α-Entropies for Graph Characterization.

IEEE transactions on neural networks and learning systems·2026

Same journal

LANet: A Lightweight and Accurate Balanced Network Based on State Space Models for Real-Time Semantic Segmentation.

IEEE transactions on neural networks and learning systems·2026

Same journal

MENDNet: Memory-Enhanced Dependency Network for Multistock Movement Prediction.

IEEE transactions on neural networks and learning systems·2026

Same journal

Temporal Mask-Embedding Learning and Query-Refined Head Network for Visual Tracking.

IEEE transactions on neural networks and learning systems·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Dec 29, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Why ResNet Works? Residuals Generalize.

Fengxiang He, Tongliang Liu, Dacheng Tao

IEEE Transactions on Neural Networks and Learning Systems

|February 8, 2020

Summary

This summary is machine-generated.

Residual connections in deep neural networks do not increase hypothesis complexity. This study provides theoretical guarantees for ResNet generalization, supporting weight decay regularization for improved performance.

Related Experiment Videos

Last Updated: Dec 29, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Area of Science:

Artificial Intelligence
Machine Learning
Deep Learning Theory

Background:

Residual connections are crucial for deep neural network (DNN) performance.
Theoretical understanding of residual connections' impact on hypothesis complexity and generalization is limited.

Purpose of the Study:

To analyze the influence of residual connections on the hypothesis complexity of DNNs.
To derive generalization bounds for networks with residual connections, exemplified by ResNet.

Main Methods:

Calculating the covering number of the hypothesis space for networks with residual connections.
Deriving margin-based multiclass generalization bounds.

Main Results:

An upper bound for the covering number of networks with residual connections was established, showing structural similarity to networks without residuals.
An O(1/√N) generalization bound was obtained for ResNet, applicable to similar architectures like DenseNet and ResNeXt.

Conclusions:

Residual connections do not inherently increase hypothesis space complexity.
Theoretical generalization bounds support the use of regularization techniques like weight decay to enhance DNN performance.