相关实验视频

Updated: Sep 17, 2025

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

具有低分辨率参数的神经网络

Eduardo Lobo Lustosa Cabral¹, Larissa Driemeier²

¹Institute for Energy and Nuclear Research and Mauá Institute of Technology, São Paulo, SP, Brazil.

Neural networks : the official journal of the International Neural Network Society

|July 3, 2025

概括

减少神经网络模型大小是提高效率的关键. 这项研究表明,更低的比特精度 (低至2.32位) 保持了性能,使其能够在内存受限的设备上使用.

科学领域:

人工智能的人工智能
计算机科学计算机科学
机器学习机器学习

背景情况:

大型神经网络模型在内存使用和计算效率方面面临挑战.
优化模型大小对于在各种应用中实际实施至关重要.

研究的目的:

研究参数比特精度对神经网络模型性能的影响.
为了将低位精度模型与标准的32位模型进行比较,用于多类对象分类.

主要方法:

对具有不同重量分辨率 (1位至4.08位) 的模型进行分析.
包括具有完全连接,卷积和变压器层的模型.
用数据增强评估性能,训练时代和稳定性.

主要成果:

低位精度模型 (例如2.32位) 的性能与32位模型相提并论.
大参数模型以更少的位数保持类似的性能;较小的模型需要更多的训练.
包括重量为零和仔细的数据增强可以提高低分辨率模型的稳定性.

结论:

2.32位权重为减少内存,性能和效率提供了最佳平衡.
低位精度模型对内存受限制的设备有很大的前景.
建议在硬件进步的同时,对各种数据集和更大的模型进行进一步的研究.

关键词:

深度学习是一种深度学习.低分辨率的低分辨率解决方案重量量化量化是重量的量化.

更多相关视频

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Anatomically Inspired Three-dimensional Micro-tissue Engineered Neural Networks for Nervous System Reconstruction, Modulation, and Modeling

Anatomically Inspired Three-dimensional Micro-tissue Engineered Neural Networks for Nervous System Reconstruction, Modulation, and Modeling

Published on: May 31, 2017

相关概念视频

Neural Circuits

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...

Neural Regulation

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.