CGE-GAN: ダイナミックな適応的重量共有を持つコントラスティブに導かれた進化的生成的対立ネットワーク
Kashif Iqbal1, Xue Yu2, Atifa Rafique1
1School of Computer, Nanjing University of Information Science and Technology, No.219, Ningliu Road, Nanjing, 210044, Jiangsu, China.
まとめ
コントラスティブ誘導進化的GAN (CGE-GAN) は,意味的アライメントとトレーニング効率を向上させることで,画像生成を改善します. この新しい方法は,計算コストを削減した高精度出力を達成します.
科学分野:
- 人工知能 (AI) とは,人工知能 (AI) のことです.
- コンピュータビジョン コンピュータビジョン
- 機械学習 (Machine Learning) とは,機械学習 (Machine Learning) について学ぶことです.
背景:
- 生成対抗ネットワーク (GAN) は,画像合成に優れているが,モード崩壊,トレーニングの不安定性,アーキテクチャ検索に苦戦している.
- 現存する進化的GANには,意味的アライメント,効果的な重量再利用,世代間の知識移転が欠けている.
研究 の 目的:
- 安定した高精度画像生成のためのコントラスティブ誘導進化的GAN (CGE-GAN) を導入する.
- セマンティック・アラインメントやトレーニングの効率性など,現在のGANの限界に対処するためです.
主な方法:
- セマンティック・アラインメントと対抗的な競争力のためのハイブリッドのワースタータイン-コントラスティヴ・損失関数を開発した.
- 効率的なトレーニングのための組み込みダイナミック・アダプティブ・ウェイトシェアリング (DAWS).
- 世代を超えて特徴の保存のための知識蒸留ベースのクロスオーバーを活用しました.
主要な成果:
- CGE-GANは,初期スコア (IS) 8.99 (CIFAR-10) と 10.46 (STL-10) を達成しました.
- 9.74 (CIFAR-10) と 21.86 (STL-10) のフレシェット発射距離 (FID) を達成しました.
- ベースラインと比較して1.74ポイントまでFIDを削減し,GPU日数はわずか0.36日でした.
結論:
- コントラスティブ駆動の進化は,安定した,高精度な画像生成に有効です.
- CGE-GANは,意味的多様性および収束効率において優れたパフォーマンスを示しています.
- 提案された方法は,GANを前進させるための有望な方向性を提供します.
関連する概念動画
Genetic Drift
44.3K
Natural selection—probably the most well-known evolutionary mechanism—increases the prevalence of traits that enhance survival and reproduction. However, evolution does not merely propagate favorable traits, nor does it always benefit populations.
44.3K
Weighted Mean
6.7K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
6.7K
Apparent Weight
9.9K
True weight is the measure of the gravitational force acting on an object. However, if the object accelerates, its measured weight is different from its true weight. Similar observations can be made when the object is submerged in water. An object's weight in water is its apparent weight, which is equal to the difference between its true weight and the buoyant forces.
Consider a person standing on a bathroom scale inside an elevator. If the scale is accurate at rest, its reading equals the...
Consider a person standing on a bathroom scale inside an elevator. If the scale is accurate at rest, its reading equals the...
9.9K
Multi-input and Multi-variable systems
431
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
431
Associative Learning
1.5K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.5K
Observational Learning
1.0K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.0K
