Related Experiment Video
Updated: Jul 19, 2026
11:54
Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
Published on: May 8, 2021
Near-optimal human adaptive control across different noise environments.
Manu Chhabra1, Robert A Jacobs
1Department of Computer Science, University of Rochester, Rochester, New York 14627, USA.
Summary
People learning complex system control adapt strategies to match system noise. They adjust control signal size based on noise type, achieving near-optimal performance by effectively using all available information.
Area of Science:
- Cognitive Psychology
- Human-Computer Interaction
- Control Theory
Background:
- Learning to control complex systems requires understanding both system dynamics and inherent noise.
- Human subjects' ability to adapt control strategies under varying noise conditions is not fully understood.
Purpose of the Study:
- To evaluate human subjects' learning and control capabilities in a stochastic dynamic system.
- To investigate how different noise characteristics influence the development of control strategies.
Main Methods:
- Human subjects controlled a stochastic dynamic system with forces corrupted by proportional or inversely proportional noise.
- Dynamic programming calculated optimal control laws for an 'ideal actor' under identical noise conditions.
- Performance was measured by comparing human strategies to ideal actor models.
Main Results:
- Subjects developed control strategies specifically adapted to the training noise conditions.
- Performance approached information-theoretic upper bounds, indicating near-optimal learning.
- Learned behaviors included using smaller control signals for proportional noise and larger signals for inversely proportional noise.
Conclusions:
- Humans can learn to effectively control complex stochastic systems by adapting to specific noise characteristics.
- Learners exhibit near-optimal behavior, efficiently utilizing information to maximize task performance.
- Findings highlight the adaptability of human motor control and learning in noisy environments.
Related Concept Videos
01:10Control Systems
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
01:26Feedback control systems
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
01:24Effects of feedback
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
01:23Optimal Arousal Theory
The optimal arousal theory suggests that performance is maximized when an individual experiences a moderate level of arousal. This theory is closely tied to the Yerkes-Dodson law, which illustrates an inverted U-shaped relationship between arousal and performance. The law, formulated by psychologists Robert Yerkes and John Dodson, implies an ideal arousal level for optimal performance, and deviations from this level can lead to declines in effectiveness.
Inverted U-Shaped Performance Curve
The...
Inverted U-Shaped Performance Curve
The...
01:05Difference from Background: Limit of Detection
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
01:07Time-Domain Interpretation of PD Control
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...