一种用于加速神经网络的几何方法,旨在解决分类问题
Mohsen Saffar1, Ahmad Kalhor2, Ali Habibnia3
1School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran. mohsen_saffar@ut.ac.ir.
Scientific reports
|July 30, 2024
概括
本研究介绍了神经网络的几何压缩技术,使用分离索引来删除非信息部分. 这种方法在像VGG16这样的网络中显著削减了参数,提高了效率.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 卷积神经网络 (CNN) 是计算密集型的,限制了它们在资源有限的设备上部署.
- 模型压缩技术对于加速CNN计算和增强概括至关重要.
- 现有的方法往往缺乏系统的方法来识别和删除非信息网络组件.
研究的目的:
- 提出一种基于几何学的新技术来压缩CNN.
- 通过消除非信息化的网络元素来加速计算和改善概括性.
- 系统地压缩卷积层和完全连接的层.
主要方法:
- 使用几何指数,分离指数,来评估网络元件的功能.
- 应用以中心为基础的分离指数,以实现卷积层和完全连接层的最佳压缩.
- 开发一种算法,排除低性能层,选择最佳过器,并调整完全连接的层参数.
主要成果:
- 在CIFAR-10和ImageNet数据集上展示了有效的压缩.
- 实现了显著的参数修剪:VGG16的87.5%,GoogLeNet的77.6%和DenseNet的78.8%.
- 在网络压缩效率方面超越了最先进的方法.
结论:
- 拟议的基于几何的压缩技术提供了一种有效的方法来减少CNN的复杂性.
- 该方法系统地识别和删除冗余的网络组件,从而提高效率和通用性.
- 这种方法为在实际应用中部署深度学习模型提供了有价值的工具.
相关概念视频
Acceleration Vectors
8.0K
In everyday conversation, accelerating means speeding up. Acceleration is a vector in the same direction as the change in velocity, Δv, therefore the greater the acceleration, the greater the change in velocity over a given time. Since velocity is a vector, it can change in magnitude, direction, or both. Thus acceleration is a change in speed or direction, or both. For example, if a runner traveling at 10 km/h due east slows to a stop, reverses direction, and continues their run at 10 km/h...
8.0K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
47
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
47
Angular Velocity and Acceleration
9.2K
We previously discussed angular velocity for uniform circular motion, however not all motion is uniform. Envision an ice skater spinning with their arms outstretched; when they pull their arms inward, their angular velocity increases. Additionally, think about a computer's hard disk slowing to a halt as the angular velocity decreases. The faster the change in angular velocity, the greater the angular acceleration. The instantaneous angular acceleration is defined as the derivative of...
9.2K
Direction of Acceleration Vectors
8.1K
Acceleration occurs when velocity changes in magnitude (an increase or decrease in speed), direction, or both. Although acceleration is in the direction of the change in velocity, it is not always in the direction of motion. When an object slows down, its acceleration is opposite to the direction of its motion. This is commonly referred to as deceleration. However, the term deceleration can cause confusion in analysis because it is not a vector; it does not point to a specific direction with...
8.1K
Kinematic Equations: Problem Solving
12.0K
When analyzing one-dimensional motion with constant acceleration, the problem-solving strategy involves identifying the known quantities and choosing the appropriate kinematic equations to solve for the unknowns. Either one or two kinematic equations are needed to solve for the unknowns, depending on the known and unknown quantities. Generally, the number of equations required is the same as the number of unknown quantities in the given example. Two-body pursuit problems always require two...
12.0K


