Related Experiment Video
Updated: Aug 21, 2025

Experimental Investigation of the Hierarchical Control in DC Microgrids Using a Real-time Simulator
Published on: February 14, 2025
Model predictive control of DC/DC boost converter with reinforcement learning.
Anup Marahatta1, Yaju Rajbhandari1, Ashish Shrestha2
1Department of Electrical and Electronics Engineering, Kathmandu University, Dhulikhel 45200, Nepal.
Reinforcement learning controllers enhance DC-DC boost converter efficiency and stability by adapting to non-linear dynamics, outperforming traditional PI controllers. This self-calibrating approach minimizes oscillations and optimizes performance under variable loads.
Area of Science:
- Power electronics and control systems engineering.
- Application of artificial intelligence in energy systems.
Background:
- Traditional Proportional-Integral (PI) controllers struggle with the inherent non-linearity of DC-DC converters, leading to transient instability and voltage fluctuations.
- The non-linear behavior of converters necessitates advanced control strategies that can adapt to varying operating conditions and loads.
Purpose of the Study:
- To investigate the efficacy of reinforcement learning (RL)-based non-linear controllers for DC-DC boost converters.
- To demonstrate the potential of RL controllers to improve control accuracy and energy efficiency compared to conventional methods.
- To develop a self-calibrating controller capable of optimizing its performance in real-time.
Main Methods:
- Utilizing a reinforcement learning model with a non-linear policy to minimize iteration and oscillation.
- Employing a support vector machine calibrated by RL to dynamically adjust the duty cycle limit under variable loads.
- Conducting simulation and experimental analyses on a DC-DC boost converter within a microgrid system.
Main Results:
- Reinforcement learning-based controllers show improved control and efficiency over standard controllers.
- The proposed RL controller effectively manages the dynamic changes in duty cycle limits required by variable loads.
- Demonstrated reduction in transient instability and voltage fluctuations compared to PI controllers.
Conclusions:
- Reinforcement learning offers a robust solution for controlling non-linear systems like DC-DC boost converters.
- Self-calibrating RL controllers provide adaptive and efficient power management, particularly in dynamic microgrid environments.
- The research validates the superiority of RL-based non-linear control for enhancing power electronic system performance.
Related Concept Videos
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Reinforcement
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Observational Learning

