事件增强的快照压缩视频在10K FPS
IEEE transactions on pattern analysis and machine intelligence
|November 11, 2024
概括
这项研究引入了一种混合强度事件成像系统,用于高速视频快照压缩成像 (SCI). 这种新的方法可以在0.1ms间隔重建详细的视频,克服传统SCI方法的局限性.
科学领域:
- 光学和光子学 在光学和光子学.
- 计算机视觉 计算机视觉
- 图像处理 图像处理
背景情况:
- 视频快照压缩成像 (SCI) 通过将动态场景压缩成单一快照来实现高速视频采集.
- 使用强度摄像头的传统SCI方法难以在被捕捉的间隔之间重建,从而丢失关键的动态信息.
- 现有的视频插入 (VFI) 方法往往缺乏非常快的动态的时间分辨率.
研究的目的:
- 开发一种新的混合成像系统,将强度和事件数据结合起来,用于增强的视频快照压缩成像.
- 克服传统SCI和VFI技术的时间解决限制.
- 为了实现高质量,高速的视频重建,改善时间细节.
主要方法:
- 提出了一种混合"强度事件成像方案",将事件摄像头集成到视频SCI设置中.
- 开发了一种双路径光学系统,同时捕获编码的强度测量和中间事件信号.
- 创建了一个双分支的变压器网络,通过利用强度和事件数据的互补信息来解码密集的视频.
主要成果:
- 与最先进的视频SCI和VFI方法相比,在广泛的模拟和现实世界的实验中表现出卓越的性能.
- 实现高质量的视频摄影,时间间隔仅为0.1ms.
- 通过结合事件摄像机信息,成功地从低率强度摄像机数据 (24 FPS) 中重建了密集的视频.
结论:
- 拟议的混合强度事件成像方案显著提升了视频快照压缩成像能力.
- 这种方法有效地利用强度和事件数据的互补性质,用于更优质的高速视频重建.
- 该系统提供了一种具有成本效益的解决方案,用于以高时间分辨率捕捉快速动态场景.
相关概念视频
01:10Instantaneous Velocity - II
9.2K
Instantaneous velocity is the quantity that measures how fast an object is moving along its path. In other words, the instantaneous velocity of an object is the limit of the average velocity as the elapsed time approaches zero, or the derivative of displacement with respect to time. Like average velocity, the instantaneous velocity is a vector with the dimensions of length per unit time. Instantaneous velocity can have both positive and negative values. The instantaneous velocity can be...
9.2K
01:15Instantaneous Velocity - I
12.3K
The average velocity during a time interval cannot tell us how fast or in what direction a particle is moving at any given time during the interval. To calculate this, it is important to know the instantaneous velocity, which is the velocity at a specific instant of time or at a specific point along the path. Instantaneous velocity is the quantity that measures how fast an object is moving along its path. In other words, the instantaneous velocity vx of an object is the limit of the average...
12.3K
01:24X-ray Imaging
5.4K
German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...
5.4K