相关实验视频
Updated: May 20, 2025

11:23
Lensless Fluorescent Microscopy on a Chip
Published on: August 17, 2011
17.6K
基于事件的摄像机的高效稀疏卷积运算机
Sen Zhang1, Fusheng Zha1,2, Xiangji Wang1
1State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, China.
Frontiers in neurorobotics
|March 27, 2025
概括
我们为基于事件的摄像头开发了一种新的稀疏卷积运算符,大大减少了90%的计算负载,并将处理速度翻了一番. 这增强了机器人对应用程序的感知,如自主导航和对象跟踪.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 计算机视觉 计算机视觉
- 生物灵感传感器 生物灵感传感器
背景情况:
- 基于事件的摄像头通过模仿生物视网膜来提供低延迟和计算效率.
- 现有的算法,优化密集的图像,创建冗余和延迟,当使用稀疏的事件数据时.
- 这种不匹配阻碍了基于事件的机器人摄像机在机器人技术中的全部潜力.
研究的目的:
- 为基于事件的摄像头开发一个专门的稀疏卷积运算符.
- 为解决当前算法的计算冗余和高延迟问题.
- 为资源有限的机器人系统提供高效和低延迟的感知.
主要方法:
- 提出了一种新的稀疏卷积运算符,专门用于基于事件的摄像头数据.
- 实施了无效子卷的选择性跳过.
- 在运算符中开发了有效计算的高效重组.
主要成果:
- 在计算工作量方面实现了近90%的减少.
- 在处理速度中获得了大约2倍的加速.
- 保持了与密度卷积运算符相比的准确性.
结论:
- 拟议的稀疏卷积运算符显著提高了基于事件的摄像头的处理效率.
- 这一创新为实时应用程序 (如自主导航和对象跟踪) 打开了新的可能性.
- 在资源有限的系统中实现高性能,低延迟的机器人感知.
相关概念视频
Convolution Properties II
155
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
155
Convolution Properties I
126
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
126
Convolution: Math, Graphics, and Discrete Signals
218
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
218
Deconvolution
123
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
123
Downsampling
117
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
117
Fast Fourier Transform
232
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
232

