Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Self-Schemas02:16

Self-Schemas

31.0K
In general, a schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
31.0K
Nonconscious Mimicry01:13

Nonconscious Mimicry

4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Cognitive Learning01:21

Cognitive Learning

229
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
229
Hindsight Biases01:12

Hindsight Biases

3.4K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now? 
3.4K
Relationship Formation02:12

Relationship Formation

39.9K
What do you think is the single most influential factor in determining with whom you become friends and whom you form romantic relationships? You might be surprised to learn that the answer is simple: the people with whom you have the most contact. This most important factor is proximity. You are more likely to be friends with people you have regular contact with. For example, there are decades of research that shows that you are more likely to become friends with people who live in your dorm,...
39.9K
The Representativeness Heuristic02:13

The Representativeness Heuristic

15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Comparison of Chinese and international birth weight standards in predicting early childhood growth outcomes: a retrospective cohort study.

Frontiers in pediatrics·2026
Same author

Photothermal Amplification via Nanorobotic Swarming Dynamics.

Advanced science (Weinheim, Baden-Wurttemberg, Germany)·2026
Same author

Development and Validation of a Novel Risk Prediction Model for Incident Diabetic Foot Complications: A Large, Longitudinal, Population-Based Machine Learning Study.

Advances in wound care·2026
Same author

Type VI secretion system: Central regulator of antimicrobial resistance dynamics via indirect mechanisms.

Microbiological research·2026
Same author

"Psychosocial adaptation challenges: striving for a new normal": the lived experiences of young and middle-aged lung cancer survivors after surgery.

European journal of oncology nursing : the official journal of European Oncology Nursing Society·2026
Same author

Ultrasound-sensitive microrobotic sensor with robust anchoring for long-term digestive lesion assessment.

National science review·2026
Same journal

Dynamic Perturbation of Weights for Improved Data Reconstruction in Unsupervised Learning.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks·2022
Same journal

DeepConsensus: Consensus-based Interpretable Deep Neural Networks with Application to Mortality Prediction.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks·2020
Same journal

Classification Based on Neuroimaging Data by Tensor Boosting.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks·2020
Same journal

Subject-Specific Convolutional Neural Networks for Accelerated Magnetic Resonance Imaging.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks·2020
Same journal

Predicting Nodule Malignancy using a CNN Ensemble Approach.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks·2018
Same journal

Representation of Deep Features using Radiologist defined Semantic Features.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks·2018
See all related articles

Related Experiment Video

Updated: Jun 12, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.5K

SMKD: Selective Mutual Knowledge Distillation.

Ziyun Li1, Xinshao Wang2, Neil M Robertson3

  • 1Hasso Plattner Institute, University of Potsdam, Potsdam, Germany.

Proceedings of ... International Joint Conference on Neural Networks. International Joint Conference on Neural Networks
|September 20, 2024
PubMed
Summary
This summary is machine-generated.

Selective mutual knowledge distillation (SMKD) enhances model reliability by filtering inaccurate information. This approach improves knowledge transfer, especially when dealing with noisy data, by selectively choosing reliable knowledge for distillation.

More Related Videos

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition
05:15

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition

Published on: February 19, 2018

10.8K
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.4K

Related Experiment Videos

Last Updated: Jun 12, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.5K
The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition
05:15

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition

Published on: February 19, 2018

10.8K
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.4K

Area of Science:

  • Machine Learning
  • Artificial Intelligence
  • Computer Science

Background:

  • Mutual knowledge distillation (MKD) facilitates collaborative knowledge transfer between models.
  • Unreliable knowledge, particularly from noisy labels, can cause models to memorize incorrect information.
  • Selective knowledge distillation is less explored than general model reliability.

Purpose of the Study:

  • To introduce a novel framework for selective mutual knowledge distillation (SMKD).
  • To address the challenge of unreliable knowledge transfer in MKD.
  • To provide a unified framework for MKD, encompassing various knowledge selection strategies.

Main Methods:

  • Developed a generic knowledge selection formulation for SMKD.
  • Implemented static and progressive selection thresholds within the SMKD framework.
  • Designed SMKD to include special cases of using no or all knowledge, unifying MKD approaches.

Main Results:

  • Demonstrated the effectiveness of the proposed SMKD framework through extensive experiments.
  • Validated the importance of selective knowledge filtering in mutual distillation.
  • Showcased SMKD's ability to improve model performance under challenging conditions.

Conclusions:

  • SMKD offers a robust solution for enhancing knowledge distillation reliability.
  • The proposed framework provides flexibility in knowledge selection strategies.
  • SMKD represents a significant advancement in the field of selective knowledge distillation.