对嵌入式系统的神经网络推理的全面分析:响应时间,校准和模型优化
Patrick Huber1,2, Ulrich Göhner3, Mario Trapp2,4
1Institute for Driver Assistance and Connected Mobility (IFM), Kempten University of Applied Sciences, Junkerstraße 1A, 87734 Benningen, Germany.
Sensors (Basel, Switzerland)
|August 14, 2025
概括
在边缘设备上优化人工神经网络 (ANN) 推断速度对于预测性维护等实时应用至关重要. 这项研究对ANN的性能进行了基准评估,揭示了谨慎的参数调整对于嵌入式系统的高效部署至关重要.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 嵌入式系统工程 嵌入式系统工程
背景情况:
- 人工神经网络 (ANN) 的实时推断速度对于嵌入式系统在边缘处理传感器数据至关重要.
- 预测性维护等应用程序需要及时预测状态变化,使ANN响应时间成为关键性能指标.
研究的目的:
- 为了能够在各种嵌入式平台上估计ANN模型响应时间.
- 分析网络参数,激活函数和线程对推断速度的影响.
- 调查网络结构对模型校准的影响以及转换到Tensorflow Lite (TFLite) 的影响.
主要方法:
- 在边缘设备上对通用ANN应用进行基准测试.
- 分析网络参数,激活函数和单线程与多线程的分析.
- 评估硬件影响,如时钟速率差异.
- 使用预期校准错误 (ECE) 量化模型校准.
主要成果:
- 响应时间受到网络参数,激活函数和线程策略的重大影响.
- 任务分区和调度的复杂性需要精确的参数协调,以实现跨平台的优化.
- 最先进的框架可能不会自动优化所有配置,可能会影响性能.
- 将模型转换为TFLite需要仔细考虑性能和校准.
结论:
- 在嵌入式系统上优化ANN推理要求采用整体方法,考虑硬件,软件和模型特定参数.
- 准确的基准测试和参数协调对于实现所需的性能和校准水平至关重要.
- 开发人员必须在资源有限的边缘设备上部署ANN时平衡性能和校准.
相关概念视频
Linear time-invariant Systems
412
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
412
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
101
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
101
Neural Regulation
40.0K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
40.0K
Transient and Steady-state Response
275
In control systems, test signals are essential for evaluating performance under various conditions. The ramp function is effective for systems undergoing gradual changes, while the step function is suitable for assessing systems facing sudden disturbances. For systems subjected to shock inputs, the impulse function is the most appropriate test signal.
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
275
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K


