Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reducing Line Loss

Reducing Line Loss

In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...

Boundary Conditions: Lossless Lines

Boundary Conditions: Lossless Lines

Consider a single-phase, two-wire, lossless transmission line terminated by an impedance at the receiving end and a source with Thevenin voltage and impedance at the sending end. The line, with length, has a surge impedance and wave velocity determined by the line's inductance and capacitance.
At the receiving end, the boundary condition states that the voltage equals the product of the receiving-end impedance and current. This relationship is expressed as a function of the incident and...

Neural Circuits

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...

Difference from Background: Limit of Detection

Difference from Background: Limit of Detection

The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...

Line Loss

Line Loss

The different configurations of source-load connections include wye (star) and delta connections. The relationship between line and phase voltages and currents varies depending on the configuration. When the source is supplying power, it is transmitted through the wires to the load, and during this transmission, some power is absorbed by the wires, leading to line loss.
Line loss impacts power delivery efficiency in a balanced three-phase circuit. The symmetry in such a circuit simplifies the...

Propagation of Action Potentials

Propagation of Action Potentials

The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Suitability of a tumour-mimicking material for the evaluation of high-intensity focused ultrasound ablation under magnetic resonance guidance.

Physics in medicine and biology·2013

Same author

Worst-case quadratic loss bounds for prediction using linear functions and gradient descent.

IEEE transactions on neural networks·1996

See all related articles

Search research articles

Related Experiment Video

Updated: Jul 7, 2026

Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations

Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations

Published on: February 15, 2017

Relative loss bounds for single neurons.

D P Helmbold¹, J Kivinen, M K Warmuth

¹Department of Computer Science, University of California, Santa Cruz, Santa Cruz, CA 95064, USA.

IEEE Transactions on Neural Networks

|February 7, 2008

Summary

Exponentiated gradient and gradient descent algorithms were compared for single neuron training. Exponentiated gradient shows superior performance when inputs have many irrelevant components, confirmed by simulations.

More Related Videos

Recording Temperature-induced Neuronal Activity through Monitoring Calcium Changes in the Olfactory Bulb of Xenopus laevis

Recording Temperature-induced Neuronal Activity through Monitoring Calcium Changes in the Olfactory Bulb of Xenopus laevis

Published on: June 3, 2016

Related Experiment Videos

Last Updated: Jul 7, 2026

Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations

Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations

Published on: February 15, 2017

Recording Temperature-induced Neuronal Activity through Monitoring Calcium Changes in the Olfactory Bulb of Xenopus laevis

Recording Temperature-induced Neuronal Activity through Monitoring Calcium Changes in the Olfactory Bulb of Xenopus laevis

Published on: June 3, 2016

Area of Science:

Machine Learning
Artificial Intelligence
Computational Neuroscience

Background:

Gradient descent is a foundational algorithm for training neural networks.
Generalization of gradient descent leads to the standard backpropagation algorithm.
Local minima pose challenges for analyzing gradient-based optimization algorithms.

Purpose of the Study:

To analyze and compare gradient descent and exponentiated gradient algorithms for single neuron training.
To derive worst-case loss bounds for both algorithms under specific conditions.
To investigate the performance differences, particularly with irrelevant input components.

Main Methods:

Developed a matching loss function for strictly increasing differentiable transfer functions to avoid local minima.
Proved worst-case loss bounds for gradient descent and exponentiated gradient using the matching loss.
Conducted simulations on synthetic data to validate analytical findings.

Main Results:

Derived distinct worst-case loss bounds for gradient descent and exponentiated gradient.
Demonstrated that exponentiated gradient outperforms gradient descent when inputs contain numerous irrelevant features.
Analytical results were corroborated by simulations.

Conclusions:

Exponentiated gradient offers advantages over gradient descent in scenarios with high-dimensional, sparse, or noisy input data.
The derived matching loss functions provide a theoretical basis for analyzing these optimization algorithms.
This research contributes to understanding the theoretical underpinnings of neural network training algorithms.