Related Experiment Video
Updated: Jul 7, 2026
11:18
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
Generalization in probabilistic RAM nets.
T G Clarkson1, Y Guan, J G Taylor
1King's Coll., London.
IEEE Transactions on Neural Networks
|January 1, 1993
Summary
Probabilistic RAM (pRAM) networks are stochastic neural devices offering high functionality. This study demonstrates how pRAM networks generalize effectively even when trained with noisy data.
Area of Science:
- Neuroscience
- Computer Science
- Hardware Engineering
Background:
- Probabilistic RAM (pRAM) represents a novel class of hardware-realizable neural devices.
- These devices are characterized by their stochastic operational nature and high degree of nonlinearity.
- Even small-scale networks composed of pRAMs exhibit significant functional capabilities.
Purpose of the Study:
- To investigate the generalization capabilities of pRAM networks when subjected to noisy training data.
- To elucidate the mechanisms underlying this generalization behavior.
- To describe the empirical results of this noise-induced generalization.
Main Methods:
- Development and simulation of small-scale pRAM networks.
- Training of pRAM networks using datasets containing varying levels of noise.
- Analysis of network performance and generalization metrics post-training.
Main Results:
- Demonstration of effective generalization in pRAM networks despite the presence of noise during training.
- Identification of specific operational characteristics that facilitate noise tolerance.
- Quantification of the performance improvements attributable to noise-induced generalization.
Conclusions:
- pRAM networks possess inherent mechanisms for robust generalization, even under noisy training conditions.
- The stochastic and nonlinear properties of pRAMs are key to their ability to generalize.
- These findings highlight the potential of pRAMs for applications requiring resilience to imperfect data.
Related Concept Videos
01:09Random Variables
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
01:24Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
01:22Multi-input and Multi-variable systems
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
01:49Probability Laws
Overview
01:13Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
00:59Propagation of Uncertainty from Random Error
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...