Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mass and Weight01:19

Mass and Weight

Mass and weight are often used interchangeably in everyday conversation. For example,  medical records often show our weight in kilograms, but never in the correct units of newtons. In physics, however, there is an important distinction. Weight is the pull of the Earth on an object. It depends on the distance from the center of the Earth. Weight dramatically varies if we leave the Earth's surface, unlike mass, which does not vary with location. On the Moon, for example, the acceleration due to...
Mass and Weight01:19

Mass and Weight

Mass and weight are often used interchangeably in everyday conversation. For example,  medical records often show our weight in kilograms, but never in the correct units of newtons. In physics, however, there is an important distinction. Weight is the pull of the Earth on an object. It depends on the distance from the center of the Earth. Weight dramatically varies if we leave the Earth's surface, unlike mass, which does not vary with location. On the Moon, for example, the acceleration due to...
Apparent Weight01:09

Apparent Weight

True weight is the measure of the gravitational force acting on an object. However, if the object accelerates, its measured weight is different from its true weight. Similar observations can be made when the object is submerged in water. An object's weight in water is its apparent weight, which is equal to the difference between its true weight and the buoyant forces.
Consider a person standing on a bathroom scale inside an elevator. If the scale is accurate at rest, its reading equals the...
Weighted Mean00:57

Weighted Mean

While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
The JAK-STAT Signaling Pathway01:20

The JAK-STAT Signaling Pathway

Several cytokine receptors have tightly bound Janus kinase or JAK proteins attached at their cytosolic tail. Small signaling molecules such as cytokines, growth hormones, or prolactins bind to the cytokine receptors and initiate their dimerization. The dimerization brings the cytosolic JAKs together that trans-phosphorylate and activates each other. The activated JAKs now phosphorylate cytosolic tails of the cytokine receptors, which serve as binding sites for adaptor proteins such as  SH2...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Study of bound water of poly-adenine using high frequency dielectric measurements.

Biophysical journal·2009
Same author

Representation and generalization properties of class-entropy networks.

IEEE transactions on neural networks·2008
Same author

Worst case analysis of weight inaccuracy effects in multilayer perceptrons.

IEEE transactions on neural networks·2008
Same author

Circular backpropagation networks embed vector quantization.

IEEE transactions on neural networks·2008
Same author

Empirical measure of multiclass generalization performance: the K-winner machine case.

IEEE transactions on neural networks·2008
Same author

K-winner machines for pattern classification.

IEEE transactions on neural networks·2008
Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013
Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011
Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011
Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011
Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011
Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011
See all related articles

Related Experiment Video

Updated: Jul 7, 2026

A Structured Rehabilitation Protocol for Improved Multifunctional Prosthetic Control: A Case Study
06:58

A Structured Rehabilitation Protocol for Improved Multifunctional Prosthetic Control: A Case Study

Published on: November 6, 2015

Statistically controlled activation weight initialization (SCAWI).

G P Drago1, S Ridella

  • 1Istituto per i Circuiti Elettronici, CNR, Genova.

IEEE Transactions on Neural Networks
|January 1, 1992
PubMed
Summary
This summary is machine-generated.

This study introduces an optimal weight initialization method for the backpropagation (BP) algorithm. The research identifies an ideal range for a scale factor (R) to enhance convergence speed and reduce training time.

More Related Videos

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

A Randomized, Sham-Controlled Trial of Cranial Electrical Stimulation for Fibromyalgia Pain and Physical Function, Using Brain Imaging Biomarkers
08:33

A Randomized, Sham-Controlled Trial of Cranial Electrical Stimulation for Fibromyalgia Pain and Physical Function, Using Brain Imaging Biomarkers

Published on: January 5, 2024

Related Experiment Videos

Last Updated: Jul 7, 2026

A Structured Rehabilitation Protocol for Improved Multifunctional Prosthetic Control: A Case Study
06:58

A Structured Rehabilitation Protocol for Improved Multifunctional Prosthetic Control: A Case Study

Published on: November 6, 2015

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

A Randomized, Sham-Controlled Trial of Cranial Electrical Stimulation for Fibromyalgia Pain and Physical Function, Using Brain Imaging Biomarkers
08:33

A Randomized, Sham-Controlled Trial of Cranial Electrical Stimulation for Fibromyalgia Pain and Physical Function, Using Brain Imaging Biomarkers

Published on: January 5, 2024

Area of Science:

  • Artificial Intelligence
  • Machine Learning
  • Neural Networks

Background:

  • The backpropagation (BP) algorithm is a cornerstone of training artificial neural networks.
  • Weight initialization significantly impacts BP algorithm performance, affecting convergence speed and stability.
  • Paralyzed neurons (PNP) can hinder effective training and learning in neural networks.

Purpose of the Study:

  • To propose an optimal weight initialization strategy for the BP algorithm.
  • To establish a relationship between the scale factor (R) and the paralyzed neuron percentage (PNP).
  • To determine an optimal range for R that minimizes the convergence time.

Main Methods:

  • Statistical analysis was employed to derive the scale factor R as a function of PNP.
  • Computer simulations were conducted to evaluate the impact of R on convergence speed.
  • Normalization factors were defined to ensure neuron independence and facilitate R determination.

Main Results:

  • An optimal range for the scale factor R was identified for efficient BP training.
  • The scale factor R was found to be proportional to the maximum weight magnitude.
  • Performance analysis demonstrated a clear link between PNP and convergence speed.

Conclusions:

  • The proposed weight initialization method significantly improves BP algorithm performance.
  • The identified optimal range for R offers a practical approach to accelerate neural network training.
  • The study provides a method to quickly determine the optimal R value through simulation.