一般的な"スキップ接続"の敵対的譲渡性について
IEEE transactions on pattern analysis and machine intelligence
|February 18, 2026
まとめ
ディープラーニングモデルのスキップ接続は,意図せずに,転送可能な対抗的な例を作成するのに役立ちます. 新しいスキップグラデントメソッド (SGM) は,さまざまなアーキテクチャとドメインでこれらの攻撃を強化します.
科学分野:
- 人工知能 (AI) とは,人工知能 (AI) のことです.
- コンピュータビジョン コンピュータビジョン
- 機械学習のセキュリティーについて
背景:
- スキップ接続は,標準条件下でのディープラーニングモデルのパフォーマンスに不可欠です.
- しかし,対立シナリオにおけるそれらの役割は,まだ十分に研究されていない.
研究 の 目的:
- 対立的な例の移転性に対するスキップ接続の影響を調査する.
- この特性を利用するための新しい方法,スキップ・グラデント・メソッド (SGM) を提案する.
主な方法:
- 敵対的な攻撃下でResNetのようなアーキテクチャのグラデントフローを分析する.
- SGMの開発は,スキップ接続グラデーションに向かってバックプロパガンダをバイアスする.
- SGMをビジョントランスフォーマー (ViT) や自然言語処理 (NLP) のモデルのような多様なアーキテクチャに拡張する.
主要な成果:
- SGMは,様々なモデルファミリー (ResNets, Transformers, LLMs) にわたる敵対的な例の移転性を大幅に改善します.
- この方法は,アンサンブル攻撃,ターゲティング攻撃,防御を持つモデルに対して有効です.
- 経験的証拠と理論的な説明は,SGMの有効性を支持しています.
結論:
- スキップ接続は,高度に転送可能な敵対的な攻撃を生成するために利用可能な脆弱性を提示します.
- SGMは敵対的な攻撃のための強力なテクニックを提供し,アーキテクチャの脆弱性を強調します.
- この発見は,セキュアなモデルアーキテクチャの設計に関する研究を促した.
さらに関連する動画
08:43Application of Granger Causality Analysis of the Directed Functional Connection in Alzheimer's Disease and Mild Cognitive Impairment
Published on: August 7, 2017
8.5K
11:09RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans
Published on: July 17, 2021
3.4K
関連する概念動画
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
4.1K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
4.1K
Associative Learning
1.5K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.5K
Propagation of Action Potentials
9.9K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
9.9K
Transfer Function to State Space
832
State-space representation is a powerful tool for simulating physical systems on digital computers, necessitating the conversion of the transfer function into state-space form. Consider an nth-order linear differential equation with constant coefficients, like those encountered in an RLC circuit. The state variables are selected as the output and its n−1 derivatives. Differentiating these variables and substituting them back into the original equation produces the state equations.
In an RLC...
In an RLC...
832
Convolution Properties I
628
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
628
Reynolds Transport Theorem
2.0K
The Reynolds transport theorem provides a framework to relate the time rate of change of an extensive property within a system to that in a control volume, which is crucial for analyzing fluid dynamics. Extensive properties, such as mass, velocity, acceleration, temperature, and momentum, can be expressed in terms of the mass of a fluid portion. These properties are called extensive because they depend on the system's size, while intensive properties are their corresponding values per unit...
2.0K
