神经网络中的同度表示提高了稳定性,提高了稳定性.
Kosio Beshkov1, Jonas Verhellen2, Mikkel Elle Lepperød3
1Department of Physics, University of Oslo, Oslo, Norway. kosio.neuro@gmail.com.
Scientific reports
|October 21, 2025
概括
神经网络可以通过保留数据结构来更好地学习,从而产生更强大,更准确的AI. 本研究介绍了一种连续和等级表示的方法,改进了概括和防御对抗攻击的方法.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 数据结构对于学习至关重要;神经网络表示应该反映输入数据距离.
- 神经科学表明,概括和强度取决于连续的,可微分的神经表示.
- 在对象识别中观察到等级表示,这意味着需要多分辨率数据处理.
研究的目的:
- 训练神经网络,在类内保持尺度结构,以实现连续和同度表示.
- 开发一个网络架构,使内部表示的层次操作.
- 调查是否保留公制结构可以提高分类的准确性和稳定性.
主要方法:
- 训练神经网络使用同度规范化术语来保持课内距离.
- 实施一种新的网络架构,用于对层次表示控制.
- 使用MNIST,CIFAR10和玩具数据集对分类任务的性能进行评估.
主要成果:
- 拟议的同度规范化提高了对MNIST和CIFAR10.0的对抗性攻击的稳定性.
- 学习的表示被证明在数据集中是异比的,除了在决策边界附近.
- 对表示的层次操纵有助于准确和强大的推断.
结论:
- 在神经表征中保留尺度和层次结构对AI性能有好处.
- 开发的方法提高了稳定性和准确性,为人工智能开发提供了有前途的方向.
- 连续和同度表示是真实数据利用和改进概括的关键.
相关概念视频
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Neural Regulation
43.1K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.1K
Isotonic and Isometric Muscle Contractions
6.6K
Two primary types of muscle contractions are isotonic and isometric, each serving unique functions and involving distinct mechanisms. Both isotonic and isometric contractions are integral to the body's complex system of movement and stability. Isotonic exercises contribute significantly to functional strength and movement, while isometric contractions are crucial for maintaining posture and joint stability.
Isotonic contractions
Isotonic contractions occur when a muscle changes length while...
Isotonic contractions
Isotonic contractions occur when a muscle changes length while...
6.6K
State Space Representation
523
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
523
Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
Improving Translational Accuracy
3.5K
3.5K

