Related Experiment Video
Updated: Jun 17, 2026
11:54
Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
Published on: May 8, 2021
Real-time reinforcement for human-machine interface control
Pierre Vassiliadis1, Daniel Leal Pinheiro2, Lisa Fleury1
1Defitech Chair of Clinical Neuroengineering, Neuro-X Institute (INX), École Polytechnique Fédérale de Lausanne (EPFL), 1202 Geneva, Switzerland; Defitech Chair of Clinical Neuroengineering, INX, EPFL Valais, Clinique Romande de Réadaptation, 1951 Sion, Switzerland.
Neuron
|June 15, 2026
Summary
Real-time reinforcement feedback rapidly improves human-machine control and learning, especially with limited sensory input. This strategy enhances force control and action exploitation, offering benefits for motor rehabilitation and assistive technologies.
Area of Science:
- Neuroscience
- Rehabilitation Engineering
- Human-Computer Interaction
Background:
- Developing effective feedback strategies is crucial for human-machine interfaces (HMIs), particularly for individuals with motor impairments.
- Current HMIs face challenges in optimizing control and providing meaningful benefits to patients with motor disabilities.
Purpose of the Study:
- To propose, validate, and characterize a personalized, closed-loop strategy delivering real-time reinforcement feedback for HMI control.
- To investigate the efficacy of this strategy in improving motor control and learning across different feedback conditions.
Main Methods:
- Five experiments involving 106 participants and two control interfaces were conducted.
- A personalized, closed-loop reinforcement feedback strategy was implemented in real time.
- Information-theoretic analyses were used to understand the mechanisms of reinforcement.
Main Results:
- Fewer than 20 reinforcement trials led to immediate improvements in force control and lasting retention gains.
- The benefits were most pronounced under conditions of limited visual and/or somatosensory feedback.
- In chronic stroke patients, real-time reinforcement improved online force control with limited visual feedback.
Conclusions:
- Real-time reinforcement is a promising strategy for enhancing HMI control, especially when sensory feedback is sparse.
- Reinforcement learning compensates for reduced feedback control and promotes the exploitation of successful actions.
- This approach holds translational relevance for various applications and patient populations with motor disabilities.
Related Concept Videos
01:10Control Systems
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
01:23Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
01:26Feedback control systems
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
01:25Control Systems: Applications
Electrical engineering plays a pivotal role in our daily lives, with control systems at the heart of many applications, from home appliances to sophisticated space shuttles. Control systems manage and regulate the behavior of devices and processes, ensuring they function safely, correctly, and efficiently.
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The direction...
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The direction...
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...