优化热电能收获,使用深度强化学习来实现动态能源管理和系统效率的优化
Chirayu Nilesh Chaudhari1, N J Rtamanyu1, Naga Sai Shreya Kunda2
1Department of Artificial Intelligence, Amrita School of Artificial Intelligence, Bengaluru, Amrita Vishwa Vidyapeetham, Bengaluru, India.
Scientific reports
|December 13, 2025
概括
深度强化学习 (DRL) 优化了热电发电机 (TEG) 的能源管理. 软演员-关键 (SAC) 在性能和能量满足方面表现出色,而其他算法则优先考虑电池寿命.
科学领域:
- 能源系统工程 能源系统工程
- 人工智能的人工智能
- 材料科学 材料科学 材料科学
背景情况:
- 静态优化方法对热电发电机 (TEG) 的动态能源管理有局限性.
- 废热回收系统具有可变的条件,需要适应性控制策略.
- 延长电池寿命和最大限度地提高系统效率对于TEG应用至关重要.
研究的目的:
- 确定最佳的深度强化学习 (DRL) 算法,用于TEG中的动态能源管理.
- 为了提高能源分配,电池寿命,在变化条件下的系统效率.
- 为了比较软行为者-关键 (SAC),近距离政策优化 (PPO) 和深度Q网络 (DQN) 算法的性能.
主要方法:
- 在模拟环境中使用马尔科夫决策过程建模了TEG系统.
- 训练了三个DRL算法 (SAC,PPO,DQN) 作为智能控制器.
- 使用累积奖励,电池健康,系统效率和能量满足率来评估性能.
主要成果:
- 软演员-批评 (SAC) 获得了最高的平均奖励 (-7 .03) 和能量满足率 (22.84%).
- PPO和其他算法展示了优越的电池健康 (100.00%),表明更好的硬件寿命.
- 深度Q网络 (DQN) 的表现最低,特别是在电池健康方面 (60.73%).
结论:
- 软行动者-关键 (SAC) 算法最适合动态TEG能源管理,因为其性能和勘探的平衡.
- 在最大限度地提高即时性能和确保长期系统硬件寿命之间存在权衡.
- DRL显示了适应可再生能源控制器的巨大潜力,需要进一步的物理硬件验证.
相关概念视频
Energy Conservation and Bernoulli's Equation
10.4K
Applying the conservation of energy principle or the work-energy theorem to an incompressible, inviscid fluid in laminar, steady, irrotational flow leads to Bernoulli's equation. It states that the sum of the fluid pressure, potential, and kinetic energy per unit volume is constant along a streamline.
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
10.4K
Efficiency of The Carnot Cycle
3.6K
The hypothetical Carnot cycle consists of an ideal gas subjected to two isothermal and two adiabatic processes. Since the internal energy of an ideal gas depends only on its temperature, which is the same before and after the completion of the Carnot cycle, there is no change in its internal energy. Hence, using the first law of thermodynamics, the total heat exchanged by the ideal gas equals the total work done. Thus, we can quantify the efficiency of the Carnot cycle via the heat exchanged...
3.6K
Thermodynamic Systems
7.4K
A thermodynamic system is a set of objects whose thermodynamic properties are of interest. The system is considered to be embedded in its surroundings or the environment. The system and its environment can exchange heat and do work on each other through a boundary that separates them. However, the immediate surroundings of the system interact with it directly and therefore have a much stronger influence on its behavior and properties.
Consider an example of tea boiling in a kettle. The...
Consider an example of tea boiling in a kettle. The...
7.4K
The Carnot Cycle
3.9K
Converting work to heat is an irreversible process, and the purpose of a heat engine is to reverse the effect partially. Heat engines aim to increase the efficiency of the reversal, that is, maximize the work retrieved from heat. If the efficiency of a heat engine were 100%, it would imply reversing the process completely without introducing any other effect. Thus, it would violate the second law of thermodynamics.
What could be the theoretical limit to the efficiency of a heat engine? The...
What could be the theoretical limit to the efficiency of a heat engine? The...
3.9K
First Law Of Thermodynamics: Problem-Solving
3.7K
The first law of thermodynamics states that the change in internal energy of the system is equal to the net heat transfer into the system minus the net work done by the system. This equation is a generalized form of energy conservation and can be applied to any thermodynamic process.
The following strategies can be used to solve any problem involving the first law of thermodynamics.
The following strategies can be used to solve any problem involving the first law of thermodynamics.
3.7K
Mechanical Efficiency of Real Machines
1.2K
The mechanical efficiency of a machine is a fundamental concept that describes how effectively a machine can convert input work into output work. According to this concept, the efficiency of a machine is equal to the ratio of the output work to the input work. An ideal machine, meaning a machine that has no energy losses, has an efficiency of one. This implies that the input work and the output work are equal.
However, in reality, no machine can be truly ideal, and all of them experience some...
However, in reality, no machine can be truly ideal, and all of them experience some...
1.2K

