Related Experiment Video
Updated: Sep 15, 2025

Interactive and Visualized Online Experimentation System for Engineering Education and Research
Published on: November 24, 2021
Q‑Learning-Based Multivariate Nonlinear Model Predictive Controller: Experimental Validation on Batch Reactor for
Abhiram Varma Vegesna1, Muralikrishna Shamaiah Narayanarao1, Kishore Bhamidipati1
1Department of Computer Science and Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka 576 104, India.
None:
This study introduces a Q-learning-based nonlinear model predictive control (QL-NMPC) framework for temperature control in batch reactors. A reinforcement learning agent is trained in simulation to learn optimal control strategies using coolant flow rate and heater current as inputs. The resulting policy, represented as a Q-table, is implemented in real time on a physical reactor setup using the NVIDIA Jetson Orin platform. The proposed QL-NMPC framework employs a value iteration-based Q-learning algorithm, enabling model-free policy optimization without explicit policy evaluation steps, and demonstrates effective temperature tracking while highlighting the potential of reinforcement learning for controlling nonlinear batch processes without relying on system identification.
Related Concept Videos
Temperature Dependence on Reaction Rate
Atoms, molecules, or ions must collide before they can react with each other. Atoms must be close together to form chemical bonds. This premise is the basis for a theory that explains many observations regarding chemical kinetics, including factors affecting reaction rates.
The collision theory is based on the postulates that (i) the reaction rate is proportional to the rate of reactant collisions, (ii) the reacting species collide in an orientation allowing contact between...
PID Controller
Temperature and Thermal Equilibrium
The concept of temperature has evolved from the common concepts of hot and cold. The scientific definition of temperature explains more than just our sense of hot and cold. Temperature is operationally defined as the quantity measured with a thermometer. Furthermore, temperature is...
Multi-input and Multi-variable systems
In the absence...
Le Chatelier's Principle: Changing Temperature
To understand this phenomenon, consider the elementary reaction:
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...

