使用敏度意识训练的物理神经网络
Tengji Xu1, Zeyu Luo1, Shaojie Liu1
1Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China.
Nature communications
|January 19, 2026
概括
敏度意识训练 (SAT) 通过提高概括性和强度来增强物理神经网络 (PNN). 这种人工智能培训方法克服了PNN开发和部署的挑战,减少了重新培训的需要.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 硬件加速器 硬件加速器
背景情况:
- 传统的硬件限制了人工智能的发展,引发了对物理神经网络 (PNN) 的兴趣.
- 培训PNN面临的挑战包括模型与现实不匹配 (in silico) 和设备特异性 (in situ).
- 部署后的干扰 (例如热漂移) 降低PNN性能,需要重新培训.
研究的目的:
- 引入和评估敏度意识培训 (SAT) 以提高PNN培训和强度.
- 为了解决当前in silico和in situPNN培训方法的局限性.
- 增强PNN对部署后干扰的弹性,而不需要再培训.
主要方法:
- 利用敏度意识最小化原则将损失景观的敏度与概括联系起来.
- 建立了损失景观度和物理系统强度之间的联系.
- 将SAT应用于in silico和in situ PNN培训范式.
主要成果:
- SAT有效地缓解了PNN中的模型-现实差距.
- 拟议的培训方法可以实现PNN模型的跨设备传输.
- SAT对部署后的干扰有很强的弹性,因此无需再培训.
- 证明了SAT在三个PNN平台和各种任务 (分类,压缩,重建,生成) 上的广泛应用.
结论:
- 敏度意识训练 (SAT) 为训练物理神经网络提供了一种强大而通用的解决方案.
- SAT增强了PNN的概括性,跨设备的可转移性和对现实世界的干扰的弹性.
- 这种方法显著提高了人工智能硬件的实际部署和可靠性.
相关概念视频
Self-Awareness and Its Effects
287
Self-awareness is a psychological state in which the individual becomes the focal point of their attention. This inward focus transforms the self into an object of contemplation and assessment, influencing how individuals perceive their actions and their alignment with personal and societal standards.Triggers and Contexts for Self-AwarenessSelf-awareness can be activated by external stimuli that make individuals visually or audibly aware of themselves, such as mirrors, cameras, or recordings.
287
Altered States of Awareness
1.0K
Altered states of consciousness represent significant deviations from one's normal mental state. These deviations can range from subtle changes in awareness to profound transformations in perception, thought processes, and sensory experiences. Altered states of consciousness can be triggered by various factors, including drug use, meditation, hypnosis, illness, or even intense fatigue.
The ingestion of substances like stimulants or hallucinogens leads to chemical alterations in the brain...
The ingestion of substances like stimulants or hallucinogens leads to chemical alterations in the brain...
1.0K
Subconsciousness and No Awareness
668
The concept of subconscious awareness refers to the processing of information below the level of conscious thought, which significantly influences both behaviors and decisions. It is also known as waking subconscious awareness. This complex level of cognition operates without the direct awareness of the individual, facilitating rapid and simultaneous handling of multiple information streams.
An illustrative example of subconscious processing is its role in problem-solving. Often, individuals...
An illustrative example of subconscious processing is its role in problem-solving. Often, individuals...
668
High-Level and Low-Level Awareness
631
Controlled processes in human consciousness represent high-alert mental states where individuals deliberately focus their attention on achieving specific goals. Controlled processes can be seen in situations like mastering new technology, where a person might become so absorbed that they ignore surrounding distractions. Such processes involve selective attention, requiring one to concentrate on particular elements of experience while disregarding others. These are governed by executive...
631
Protein Networks
4.5K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.5K
Physical and Chemical Properties of Matter
165.4K
The characteristics that enable us to distinguish one substance from another are called properties.
165.4K


