Learning combined feedback and feedforward control of a musculoskeletal system

The goal of this paper is the learning of neuromuscular control, given the following necessary conditions: (1) time delays in the control loop, (2) non-linear muscle characteristics, (3) learning of feedforward and feedback control, (4) possibility of feedback gain modulation during a task. A control system and learning methodology that satisfy those conditions is given. The control system contains a neural network, comprising both feedforward and feedback control. The learning method is backpropagation through time with an explicit sensitivity model. Results will be given for a one degree of freedom arm with two muscles. Good control results are achieved which compare well with experimental data. Analysis of the controller shows that significant differences in controller characteristics are found if the loop delays are neglected. During a control task the system shows feedback gain modulation, similar to experimentally found reflex gain modulation during rapid voluntary contraction. If only limited feedback information is available to the controller the system learns to co-contract the antagonistic muscle pair. In this way joint stiffness increases and stable control is more easily maintained.