Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Neural Circuits01:25

Neural Circuits

1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Photoreceptor Vulnerability to Ferroptosis: Membrane Phospholipid Peroxidation, Mitochondrial Homeostasis, and RPE-Photoreceptor Coupling.

Current issues in molecular biology·2026
Same author

The splicing factor hnRNPA1 promotes osimertinib resistance in lung adenocarcinoma by regulating NEDD4L alternative splicing.

Oncogene·2026
Same author

Microglial regulation of synaptic plasticity in transsynaptic degeneration of glaucoma.

Frontiers in neuroscience·2026
Same author

Rosavin ameliorates alcoholic fatty liver disease through PPARG-dependent inhibition of the p38 MAPK and IGF-1 pathways.

Biochemical pharmacology·2026
Same author

Growth of a legend: a decadal comparison at Lost City hydrothermal field.

Science bulletin·2026
Same author

High-entropy lattice disordering enhances ion migration in LaCl<sub>3</sub>-based solid-state electrolytes.

Chemical communications (Cambridge, England)·2026
Same journal

Research on a Regional Availability Evaluation Model for Road-Area High-Entropy Energy Based on Synergy Factors.

Entropy (Basel, Switzerland)·2026
Same journal

Atmospheric Turbulence Channel Modeling and Performance Analysis of a CO-ZP-OFDM Coherent Optical Communication System for UAV Air-to-Ground Scenarios.

Entropy (Basel, Switzerland)·2026
Same journal

Information Geometry and Asymptotic Theory for SMML Estimators.

Entropy (Basel, Switzerland)·2026
Same journal

Correlation Entropy and Power-Law Kinetics.

Entropy (Basel, Switzerland)·2026
Same journal

Research on the Contagion of Systemic Financial Risk Under the Impact of Climate Risks-From the Perspective of Complex Networks and Machine Learning.

Entropy (Basel, Switzerland)·2026
Same journal

The Statistical-Mechanical Meaning of the Wave Function of Quantum Mechanics.

Entropy (Basel, Switzerland)·2026
查看所有相关文章

相关实验视频

Updated: Sep 18, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

650

对二进制神经网络的基于注意力的批量规范化

Shan Gu1, Guoyin Zhang1, Chengwei Jia1

  • 1College of Computer Science and Technology, Harbin Engineering University, Harbin 150009, China.

Entropy (Basel, Switzerland)
|June 26, 2025
PubMed
概括
此摘要是机器生成的。

基于注意力的批量规范化 (ABN) 通过整合自我注意力机制来增强二进制神经网络 (BNN). 这种新的方法可以提高图像分类的准确性和跨各种数据集和架构的模型稳定性.

关键词:
二元神经网络二元神经网络批量规范化的批量规范化卷积神经网络是一种卷积神经网络.深度学习是一种深度学习.

更多相关视频

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

530

相关实验视频

Last Updated: Sep 18, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

650
Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

530

科学领域:

  • 计算机科学 计算机科学
  • 人工智能的人工智能
  • 机器学习 机器学习

背景情况:

  • 二元神经网络 (BNNs) 使用离散的{-1,1}激活,与完全精确的网络有很大的不同.
  • 批量规范化 (BN) 对BNN性能至关重要,但由于激活约束,其作用需要特定的理解.
  • 现有研究强调了需要针对BNN量身定制的新型BN方法.

研究的目的:

  • 为二进制神经网络 (BNN) 引入一种新的基于注意力的批量规范化 (ABN) 方法.
  • 调查BNN层内的自我注意机制对BNN的影响.
  • 分析ABN提供的性能改进和稳定性增长.

主要方法:

  • 通过将自我注意纳入BN层,开发了基于注意的批量规范化 (ABN).
  • 进行了废除研究,以分析ABN方法中的参数权衡.
  • 对ABN对BNN特征和性能的影响进行实验分析.

主要成果:

  • ABN有效地捕捉图像特征,并提供类似激活的功能,提高BNN的性能.
  • 该方法增加了激活分布不平衡,有助于提高准确性.
  • 在CIFAR10,CIFAR100和TinyImageNet的图像分类实验中,ABN始终表现优于标准BN.

结论:

  • 基于注意力的批量规范化 (ABN) 对BNN的标准批量规范化提供了显著的改进.
  • 在图像分类任务中,ABN提高了BNN的准确性和稳定性.
  • 拟议的方法在不同的数据集和网络架构中展示了稳定性.