对于可解释的神经网络的对齐-可逆性规范化
IEEE transactions on pattern analysis and machine intelligence
|February 17, 2026
概括
本研究介绍了Bort和DBort,这些新型优化器通过理论原理和参数约束来增强深度神经网络的可解释性. 波特提高了模型的准确性,并产生了可解释的对抗性例子,提高了AI的可靠性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 深度神经网络 (DNN) 功能强大,但缺乏透明度,限制了它们在高可靠性领域的使用.
- 现有的可解释性方法往往缺乏理论依据,需要复杂的模型更改.
- 解密DNN对于更广泛的采用和信任至关重要.
研究的目的:
- 为了使可解释性的理论性质正式化:对齐和可逆性.
- 介绍Bort,一个插件运行优化器,强制执行边界性和直角性,以改善可解释性.
- 开发DBort,Bort的数据意识扩展,用于增强的特征归属.
主要方法:
- 正式化对齐和可逆性作为解释性的理论支柱.
- 开发了Bort,这是一个强加边界性和直角性约束的优化器.
- 引入DBort与辅助损失项,在线性情况下汇聚到PCA.
- 对约束遵守的惩罚条款 ($l_1$ vs. $l_2$) 的分析.
主要成果:
- 波特和DBort显著提高模型可解释性,通过重建和回溯实验证明了这一点.
- 基于 $l_1$ 的处罚显示了比基于 $l_2$ 的处罚更严格的约束遵守.
- 波特允许在没有额外的培训的情况下合成可解释的对抗性示例.
- 在各种架构 (ResNet,Diet) 和数据集 (MNIST,CIFAR-10,ImageNet) 中对分类准确性的持续改进.
结论:
- 波特和DBort提供了一种基于理论的方法来提高DNN的解释性.
- 这些方法在不牺牲性能的情况下提高了模型的解释性,甚至可以提高准确性.
- 开发的技术有助于创建更可靠和值得信赖的AI系统.
相关概念视频
Neural Regulation
43.6K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.6K
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
4.1K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
4.1K
Neural Circuits
2.9K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.9K
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
346
Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
346
Linearization and Approximation
85
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
85
Application of Nonlinear Inequalities
268
A nonlinear inequality describes a comparison involving an expression that curves or behaves more complexly than a straight line. These inequalities often appear in forms that include squares, products, or variables in the denominator.To solve such an inequality, one starts by rewriting it so that zero appears on one side. For example, the inequality: can be factored as: This form makes it easier to identify the values that cause the expression to equal zero. In this case, the...
268


