Jove
Visualize
Contact Us

Related Concept Videos

Associative Learning01:27

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Purposive Learning01:22

Purposive Learning

E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a bonus...
Introduction to Learning01:18

Introduction to Learning

Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Adaptive natural gradient learning algorithms for various stochastic models.

Neural networks : the official journal of the International Neural Network Society·2001
Same author

Local minima and plateaus in hierarchical structures of multilayer perceptrons.

Neural networks : the official journal of the International Neural Network Society·2000
Same author

Adaptive method of realizing natural gradient learning for multilayer perceptrons.

Neural computation·2000
Same author

Probabilistic design of layered neural networks based on their unified framework.

IEEE transactions on neural networks·1995
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jul 7, 2026

Artificial Intelligence-Based System for Detecting Attention Levels in Students
06:37

Artificial Intelligence-Based System for Detecting Attention Levels in Students

Published on: December 15, 2023

Statistical active learning in multilayer perceptrons.

K Fukumizu1

  • 1Brain Science Institute, RIKEN, Saitama, Japan.

IEEE Transactions on Neural Networks
|February 6, 2008
PubMed
Summary

This study introduces probabilistic active learning methods to improve training data generation for multilayer perceptrons, preventing local minima and ensuring stable application.

Area of Science:

  • Machine Learning
  • Artificial Intelligence
  • Neural Networks

Background:

  • Multilayer perceptrons (MLPs) face challenges in training data generation.
  • Deterministic input location selection can lead to dense distributions and local minima in backpropagation.
  • Singular Fisher information matrices hinder active learning in MLPs.

Purpose of the Study:

  • To propose novel methods for active data generation in MLPs.
  • To address issues of local minima and singular Fisher information matrices.
  • To enhance the stability and effectiveness of active learning for MLPs.

Main Methods:

  • Developed two probabilistic active learning methods: parametric active learning and multipoint-search active learning.
  • Utilized statistical variance of input locations to avoid dense distributions.

Related Experiment Videos

Last Updated: Jul 7, 2026

Artificial Intelligence-Based System for Detecting Attention Levels in Students
06:37

Artificial Intelligence-Based System for Detecting Attention Levels in Students

Published on: December 15, 2023

  • Introduced a technique for pruning redundant hidden units to maintain Fisher information matrix regularity.
  • Main Results:

    • Proposed methods effectively prevent dense input location distributions.
    • Pruning technique ensures Fisher information matrix regularity for stable active learning.
    • Demonstrated effectiveness through simulations on artificial and real-world color conversion problems.

    Conclusions:

    • Probabilistic active learning methods offer a robust solution for MLP training data generation.
    • The proposed techniques enhance the applicability and stability of active learning in MLPs.
    • These advancements contribute to more efficient and reliable neural network training.