神经缩放:消除和超级解决神经形态事件和尖端
IEEE transactions on pattern analysis and machine intelligence
|August 14, 2023
概括
本研究引入了一个3D U-Net模型来增强神经形相机数据,改善动态视觉传感器和尖相机的信号噪声比和空间分辨率. 无色化和超分辨率技术提高了对象跟踪和图像重建的性能.
科学领域:
- 计算机视觉 计算机视觉
- 神经形态工程的神经形态工程
- 人工智能的人工智能
背景情况:
- 神经形相机在动态范围,延迟和功率方面具有优势,但在信号对噪声和空间分辨率方面落后.
- 解决这些局限性对于释放这种新兴成像技术的全部潜力至关重要.
研究的目的:
- 开发和评估一种深度学习方法,用于从神经形态相机中删除和超分辨率的数据.
- 为了提高来自动态视觉传感器和尖峰摄像机的信号质量.
主要方法:
- 采用3D U-Net神经网络架构来执行无声化和超分辨率任务.
- 在使用定制显示摄像系统的动态视觉传感器和尖峰摄像机的数据上训练和测试模型.
- 在网络的两端使用了无过的噪音数据的噪音对噪音训练策略.
主要成果:
- 在神经形态相机数据的信号对噪声水平和空间分辨率方面取得了显著的改善.
- 在下游应用中验证了增强数据的有效性,例如基于事件的对象跟踪和图像重建.
- 在这些应用程序中实现了后升级的最先进的性能.
结论:
- 3D U-Net 方法有效地否定和增强神经形相机输出的空间分辨率.
- 改进的神经形态数据质量转化为在关键计算机视觉任务中的卓越性能.
- 这项工作为更强大,更有能力的神经形态成像系统铺平了道路.
更多相关视频
相关概念视频
Integration of Synaptic Events
1.6K
Synaptic integration mainly includes the summation of graded potentials. Graded potentials, regardless of their type, cause subtle alterations in membrane voltage, resulting in either depolarization or hyperpolarization. These incremental changes, when combined or summed, can propel the neuron toward its threshold. Consider, for example, a membrane experiencing a +15 mV shift, causing it to depolarize from -70 mV to -55 mV. In this scenario, graded potentials govern the membrane's ability to...
1.6K
Upsampling
262
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
262
Super-resolution Fluorescence Microscopy
7.1K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.1K
Downsampling
185
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
185
Neural Circuits
1.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.3K


