激光通信卫星系统的光学稳定通过比例-积分-导数 (PID) 控制和强化学习方法
A Reutov1, S Vorobey1, A Katanskiy1
1LLC Science Trends, 119331 Moscow, Russia.
The Review of scientific instruments
|March 31, 2025
概括
本研究引入了一种联合强化学习 (RL) 和比例整合导数 (PID) 控制方法,用于卫星到地面通信中的精确光学稳定,提高量子密钥分布的准确性.
科学领域:
- 视觉通信系统工程 视觉通信系统工程
- 控制系统理论 控制系统理论
- 量子信息科学是一种量子信息科学.
背景情况:
- 精确的光学稳定对于卫星到地面通信至关重要,包括自由空间量子密钥分布 (QKD).
- 比例积分导数 (PID) 控制器被广泛用于光学系统中的控制任务.
- 将经典控制器与强化学习 (RL) 结合在一起的复合控制系统非常有前途.
研究的目的:
- 将强化学习 (RL) 代理应用于量子密钥分配 (QKD) 终端的实验光学稳定系统.
- 使用RL代理控制历史识别更精确的PID参数.
- 开发一种有效的RL-PID组合动态控制方法,用于卫星到地面通信中的光学稳定.
主要方法:
- 在实验光学稳定装置上实施强化学习 (RL) 代理.
- 使用RL代理的控制历史来优化比例整合导数 (PID) 控制器参数.
- 开发和测试混合控制策略,整合RL和PID用于动态光学稳定.
主要成果:
- 该RL代理成功识别了优化的PID参数.
- 综合RL-PID动态控制方法被证明对光学稳定有效.
- 在定位,导航和光学稳定方面提高了准确性,用于卫星到地面通信.
结论:
- 拟议的RL-PID联合控制策略提高了卫星到地面通信的光学稳定精度.
- 强化学习为复杂光学系统中PID控制器调整提供了一种可行的方法.
- 这种方法对自由空间量子密钥分布的可靠性和性能有重大影响.
相关概念视频
01:07Time-Domain Interpretation of PD Control
75
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
75
01:24PI Controller: Design
157
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
157
01:19PID Controller
85
Proportional-Integral-Derivative (PID) controllers are widely used in various control systems to enhance stability and performance. In a thermostat, it adjusts heating or cooling based on the temperature difference between the actual and desired levels. They are often used in automotive speed systems, effectively managing sudden speed changes while maintaining a constant speed under varying conditions. On the other hand, PI controllers, commonly employed in voltage regulation, enhance stability...
85
01:24Pole and System Stability
224
The transfer function is a fundamental concept representing the ratio of two polynomials. The numerator and denominator encapsulate the system's dynamics. The zeros and poles of this transfer function are critical in determining the system's behavior and stability.
Simple poles are unique roots of the denominator polynomial. Each simple pole corresponds to a distinct solution to the system's characteristic equation, typically resulting in exponential decay terms in the system's...
Simple poles are unique roots of the denominator polynomial. Each simple pole corresponds to a distinct solution to the system's characteristic equation, typically resulting in exponential decay terms in the system's...
224
01:27Time and frequency -Domain Interpretation of PI Control
93
Proportional-Integral (PI) controllers are essential in many control systems to improve stability and performance. They are commonly used in everyday devices like thermostats to enhance system damping and reduce steady-state error. When the zero in the controller's transfer function is optimally placed, the system benefits significantly in terms of stability and accuracy.
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires...
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires...
93
01:26Feedback control systems
256
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
256