Related Experiment Videos
Comments on local minima free conditions in multilayer perceptrons
Abstract:
In this letter we point out that multilayer neural networks (MLP's) with either sigmoidal units or radial basis functions can be given a canonical form with positive interunits weights, which does not restrict the well-known MLP universal computational capabilities. We give some results on the local minima of the error function using this canonical form. In particular, we prove that the local minima free conditions established in previous works can be relaxed significantly.
Related Concept Videos
Local Maximum and Minimum Values
Lagrange Multipliers: Two Constraints
Multi-input and Multi-variable systems
In the absence of...
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
Reducing Line Loss
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...