Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

8.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
8.3K
Residual Plots01:07

Residual Plots

5.3K
A residual plot is a statistical representation of data used to analyze correlation and regression results. It helps verify the requirements for drawing specific conclusions about correlation and regression. To obtain the residual plot, first, the residual for each data value is calculated, which is simply the vertical distance between the observed and the predicted value obtained from the regression equation.
When the residual values are plotted against the variable x, it is called a residual...
5.3K
Distillation: Vapor–Liquid Equilibria01:01

Distillation: Vapor–Liquid Equilibria

3.8K
Distillation is a separation technique that takes advantage of the boiling point properties of disparate elements in a mixture. To perform distillation, we begin by heating a miscible mixture of two liquids with a significant difference in boiling points (at least 20°C). As the solution heats up and reaches the bubble point of the more volatile component, some molecules of the more volatile component transition into the gas phase and travel upward into the condenser, which is a glass tube...
3.8K
Deductive Reasoning01:16

Deductive Reasoning

63.0K
Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the opposite direction as compared to inductive reasoning, which means that it uses a general principle or law to predict specific results. From those general principles, a scientist can deduce and predict the specific results that would be valid as long as the general principles are valid.
For example, a researcher can deduce specific predictions...
63.0K
Hindsight Biases01:12

Hindsight Biases

4.1K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now? 
4.1K
Observational Learning01:12

Observational Learning

600
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
600

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

What and Where: Learn to Plug Adapters via NAS for Multidomain Learning.

IEEE transactions on neural networks and learning systems·2021
Same author

Metal-Organic Framework Membrane Nanopores as Biomimetic Photoresponsive Ion Channels and Photodriven Ion Pumps.

Angewandte Chemie (International ed. in English)·2020
Same author

Graphdiyne oxide: a new carbon nanozyme.

Chemical communications (Cambridge, England)·2020
Same author

Egg and egg-sourced cholesterol consumption in relation to mortality: Findings from population-based nationwide cohort.

Clinical nutrition (Edinburgh, Scotland)·2020
Same author

A blood-based 22-gene expression signature for hepatocellular carcinoma identification.

Annals of translational medicine·2020
Same author

Identification of Four Pathological Stage-Relevant Genes in Association with Progression and Prognosis in Clear Cell Renal Cell Carcinoma by Integrated Bioinformatics Analysis.

BioMed research international·2020
Same journal

Change-Prior-Guided Unsupervised Change Detection of Heterogeneous Remote Sensing Images.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

AgonicDreamer: Enhancing Multi-View Consistency in Text-to-3D Generation via Rectified Score Distillation.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

BiCM-Prompt: Bidirectional Cross-Modal Prompt Tuning for Class-Incremental Learning on Multisource Remote Sensing Images.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

GoP-based Quality Enhancement on Video Compression.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

Align then Tensorize: Multi-Level Consistent Anchor Graph Learning for Scalable Multi-View Clustering.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

Beyond Fidelity: Diverse Image Synthesis via Retrieval-Augmented Diffusion.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
See all related articles

Related Experiment Video

Updated: Nov 12, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

878

ResKD: Residual-Guided Knowledge Distillation.

Xuewei Li, Songyuan Li, Bourahla Omar

    IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
    |March 19, 2021
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces residual-guided knowledge distillation to train lightweight neural networks. The novel method significantly reduces computational costs while maintaining competitive performance across various datasets.

    More Related Videos

    A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports
    07:35

    A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports

    Published on: October 13, 2023

    1.9K
    A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers
    08:05

    A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers

    Published on: January 5, 2018

    9.9K

    Related Experiment Videos

    Last Updated: Nov 12, 2025

    Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
    05:47

    Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

    Published on: June 13, 2025

    878
    A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports
    07:35

    A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports

    Published on: October 13, 2023

    1.9K
    A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers
    08:05

    A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers

    Published on: January 5, 2018

    9.9K

    Area of Science:

    • Artificial Intelligence
    • Machine Learning
    • Computer Vision

    Background:

    • Knowledge distillation is a key technique for neural network compression.
    • A significant performance gap often exists between heavy teacher and lightweight student networks due to capacity differences.

    Purpose of the Study:

    • To address the performance gap in knowledge distillation.
    • To develop a more efficient lightweight student network using residual guidance.

    Main Methods:

    • Introduced a 'res-student' trained on the knowledge gap (residual) between teacher and student.
    • Combined the student and res-student, iteratively refining the process.
    • Proposed a sample-adaptive inference strategy to reduce computational cost.

    Main Results:

    • Achieved competitive performance with significantly reduced computational costs (18.04% to 56.86% of teacher costs).
    • Demonstrated effectiveness across CIFAR-10, CIFAR-100, Tiny-ImageNet, and ImageNet datasets.
    • Validated through thorough theoretical and empirical analysis.

    Conclusions:

    • Residual-guided knowledge distillation effectively bridges the performance gap.
    • The proposed method offers a tunable trade-off between accuracy and computational cost.
    • Sample-adaptive inference further enhances efficiency for practical deployment.