制限された多目的最適化のための深層補強学習による進化アルゴリズムの自動構成
IEEE transactions on cybernetics
|September 5, 2025
まとめ
この研究は,深層補強学習 (DRL) を使用した制限された多目的最適化進化アルゴリズム (CMOEA) の自動化されたアルゴリズム設計を導入します. この新しいアプローチは 理想的な構成を自己学習し 伝統的な方法を上回ります
科学分野:
- 進化論的な計算
- 人工知能
- 最適化アルゴリズム
背景:
- 自動化されたアルゴリズムの設計は,制限された多目的最適化進化アルゴリズム (CMOEA) に不可欠です.
- 現在の学習支援型CMOEAは,手作業で設計され,しばしば最適化されていない技術に依存しています.
- 既存の方法は,ダイナミックな最適化環境において多用途性と適応性が欠けている.
研究 の 目的:
- 汎用的で効果的なCMOEAの自動化構成方法を開発する.
- CMOEAのパラメータとオペレータの自己適応のための深層補強学習 (DRL) を活用する.
- 自動設計によるCMOEAの性能と適応性を向上させる.
主な方法:
- CMOEAのオンライン構成を分散的かつ連続したパラメータ決定に変換した.
- 応用深層補強学習 (DRL),特にActor-Criticと深層Q学習,自動化された構成.
- 自動的に構成された進化アルゴリズム (EA) を組み込んだ新しいCMOEAを開発しました.
主要な成果:
- DRLで構成されたCMOEAは,最先端の11の方法と比較して有意な性能改善を示した.
- 挑戦的なベンチマークと現実世界の問題に関する実験で 提案されたメソッドの優位性が確認されました
- 自動化された構成は,手作業のアプローチと比較して,より大きな汎用性と有効性を示しました.
結論:
- DRLを使用した自動構成は,進化的マルチオブジェクトの最適化を進めるための有望な方向性を提供します.
- DRLで構成されたCMOEAの自己学習能力は,その適応性とパフォーマンスを高めます.
- この研究は,多用途で高性能なCMOEAを設計するための新しいパラダイムを確立しています.
関連する概念動画
Multi-input and Multi-variable systems
147
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
147
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
100
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
100
Avoidance Learning and Learned Helplessness
1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K
Reinforcement Schedules
239
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
239
Reinforcement
341
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
341
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.3K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.3K


