Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

458
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
458
Case Studies01:22

Case Studies

11.6K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.6K
Real-World Application of Classical Conditioning01:15

Real-World Application of Classical Conditioning

531
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
531
The Representativeness Heuristic02:13

The Representativeness Heuristic

15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K
Inductive Reasoning00:59

Inductive Reasoning

60.1K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
60.1K
Stereotype Content Model02:16

Stereotype Content Model

14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Primary Cilia as Integrative Hubs of Metabolic Signaling in Type 2 Diabetes: Inter-Organ Evidence From Central, Peripheral, and Pancreatic Islet Tissues.

Journal of cellular physiology·2026
Same author

A pan-cancer single-cell atlas uncovers the role of sex hormones and chromosomes in sex-divergent reprogramming of the tumor microenvironment.

Cell communication and signaling : CCS·2026
Same author

Mechanotransduction in glioma stem cell fate determination: from niche mechanics to therapeutic vulnerability and state plasticity.

Frontiers in cell and developmental biology·2026
Same author

WAT-to-BAT communication facilitates the sustained activation of BAT thermogenesis during cold exposure.

Cell discovery·2026
Same author

Sti1 participates in the dynamics of protein aggregation triggered by glucose signaling in <i>Saccharomyces cerevisiae</i>.

Acta biochimica et biophysica Sinica·2026
Same author

A small heat shock protein from Arabidopsis thaliana regulates glyceraldehyde-3-phosphate dehydrogenase in the drought tolerance.

Plant cell reports·2026

Related Experiment Video

Updated: Jun 10, 2025

Defining the Role Of Language in Infants' Object Categorization with Eye-tracking Paradigms
07:31

Defining the Role Of Language in Infants' Object Categorization with Eye-tracking Paradigms

Published on: February 8, 2019

6.5K

On the Generalization Ability of Unsupervised Pretraining.

Yuyang Deng1, Junyuan Hong2, Jiayu Zhou2

  • 1Penn State University.

Proceedings of Machine Learning Research
|October 18, 2024
PubMed
Summary

This study introduces a new theory explaining how unsupervised pre-training improves model generalization. It reveals the key factor for knowledge transferability, enhancing fine-tuned model performance on downstream tasks.

More Related Videos

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

19.9K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

508

Related Experiment Videos

Last Updated: Jun 10, 2025

Defining the Role Of Language in Infants' Object Categorization with Eye-tracking Paradigms
07:31

Defining the Role Of Language in Infants' Object Categorization with Eye-tracking Paradigms

Published on: February 8, 2019

6.5K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

19.9K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

508

Area of Science:

  • Machine Learning
  • Artificial Intelligence
  • Deep Learning

Background:

  • Unsupervised pre-training followed by fine-tuning enhances model generalization.
  • A theoretical gap exists in understanding how pre-training representations impact fine-tuned model generalization, especially considering distribution and task heterogeneity.

Purpose of the Study:

  • To develop a novel theoretical framework to analyze the transferability of unsupervised pre-training knowledge.
  • To illuminate the critical factors affecting fine-tuned model generalization on downstream tasks.

Main Methods:

  • Developed a novel theoretical framework for analyzing unsupervised pre-training and fine-tuning.
  • Applied the framework to analyze generalization bounds for Context Encoder and Masked Autoencoder pre-training methods.
  • Investigated deep neural networks and deep transformers for pre-training, followed by binary classification fine-tuning.

Main Results:

  • Identified a critical factor influencing knowledge transferability from pre-training to fine-tuning.
  • Provided theoretical analysis of generalization bounds for specific pre-training scenarios.
  • Proposed a novel regularization method to improve fine-tuned model generalization.

Conclusions:

  • The study offers a deeper understanding of the unsupervised pre-training and fine-tuning paradigm.
  • Findings can guide the development of more effective pre-training algorithms for improved generalization.