A local minimum for the 2-3-1 XOR network
Related Experiment Videos
IEEE Transactions on Neural Networks
|February 7, 2008
Abstract:
It was assumed proven that two-layer feedforward neural networks with t-1 hidden nodes, when presented with t input patterns, can not have any suboptimal local minima on the error surface. In this paper, however, we shall give a counterexample to this assumption. This counterexample consists of a region of local minima with nonzero error on the error surface of a neural network with three hidden nodes when presented with four patterns (the XOR problem). We will also show that the original proof is valid only when an unusual definition of local minimum is used.
Related Concept Videos
Network Function of a Circuit
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
Norton Equivalent Circuits
Norton's theorem is a fundamental concept in the field of electrical engineering that allows for the simplification of complex AC circuits. The theorem states that any two-terminal linear network can be replaced with an equivalent circuit that consists of an impedance, which is parallel with a constant current source. Figure 1 shows the AC circuit portioned into two parts: Circuit A and Circuit B, while Figure 2 depicts the circuit obtained by replacing Circuit A by its Norton equivalent...
Local Maximum and Minimum Values
In multivariable calculus, a function of two variables can exhibit local maximum or minimum values at certain points on its surface. A local maximum occurs when the function's value at a point is greater than at all nearby points, while a local minimum occurs when the function’s value is less than at all nearby locations. These points are referred to as local extrema and are of central importance in optimization problems.Local extrema are found at critical points, where the surface becomes...
Thevinin's Theorem
Thévenin's theorem plays a pivotal role in electrical circuit analysis, offering a solution to the challenges posed by variable loads within a circuit. In practical applications, it is common to encounter circuits where certain elements remain fixed while others fluctuate, often referred to as the "load." A typical household electrical outlet serves as a prime example of a variable load, as it can be connected to a variety of appliances, each with its own unique electrical characteristics.
Equivalent Resistance
In circuit analysis, situations often arise where resistors are neither in series nor parallel configurations. To tackle such scenarios, three-terminal equivalent networks like the wye (Y) (Figure 1 (a)) or tee (T) and delta (Δ) (Figure 1 (b)) or pi (π) networks come into play. These networks offer versatile solutions and are frequently encountered in various applications, including three-phase electrical systems, electrical filters, and matching networks.
First-Order Circuits
First-order electrical circuits, which comprise resistors and a single energy storage element - either a capacitor or an inductor, are fundamental to many electronic systems. These circuits are governed by a first-order differential equation that describes the relationship between input and output signals.
One common example of a first-order circuit is the RC (resistor-capacitor) circuit. These circuits are used in relaxation oscillators such as neon lamp oscillator circuits. When voltage is...
One common example of a first-order circuit is the RC (resistor-capacitor) circuit. These circuits are used in relaxation oscillators such as neon lamp oscillator circuits. When voltage is...