相关实验视频
Updated: May 10, 2026

11:23
Lensless Fluorescent Microscopy on a Chip
Published on: August 17, 2011
17.6K
Pix2HDR - 一个基于像素的获取和基于深度学习的合成方法,用于高速的HDR视频
概括
这项研究引入了一种新的方法来捕捉高速,高动态范围 (HDR) 视频,通过在各种曝光时采样单个像素. 这种技术克服了传统相机的局限性,在充满挑战的动态场景中实现了清晰的视频捕捉.
科学领域:
- 计算机视觉 计算机视觉
- 图像传感器 图像传感器
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 捕捉动态场景与广泛的运动和光强度对于视觉应用至关重要.
- 由于率限制,传统摄像机在高速,高动态范围 (HDR) 视频中扎.
- 现有的多次曝光方法牺牲了速度,并可能引入来自动作错位的工件.
研究的目的:
- 开发一种用于获取高速HDR视频的方法,克服当前技术的权衡.
- 为了能够准确地捕捉快速运动和极端照明变化的场景.
- 提高视觉系统在动态环境中的适应性和性能.
主要方法:
- 实现了一个可编程的像素智能图像传感器,用于单个像素采样,具有不同的曝光和相位偏移.
- 开发了一种深度神经网络方法,通过端到端的学习权重将像素智能输出转换为HDR视频.
- 利用一种新的采样模式,同时捕捉快速运动和高动态范围.
主要成果:
- 在每秒1000 (FPS) 的速度实现了无别名的HDR视频采集.
- 在低光条件下和在明亮的背景下成功地解决了快速运动.
- 在拍摄的视频中展示了最小化的动作模糊和高时空分辨率.
结论:
- 拟议的像素智能采样与深度神经网络相结合,显著提高了HDR视频采集能力.
- 这种方法解决了捕捉动态场景的关键挑战,优于传统相机.
- 该方法为在苛刻条件下运行的视觉系统提供了更大的适应性和性能.
更多相关视频
相关概念视频
Light Acquisition
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
Phase Contrast and Differential Interference Contrast Microscopy
Phase-Contrast Microscopes
In-phase-contrast microscopes, interference between light directly passing through a cell and light refracted by cellular components is used to create high-contrast, high-resolution images without staining. It is the oldest and simplest type of microscope that creates an image by altering the wavelengths of light rays passing through the specimen. Altered wavelength paths are created using an annular stop in the condenser. The annular stop produces a hollow cone of...
In-phase-contrast microscopes, interference between light directly passing through a cell and light refracted by cellular components is used to create high-contrast, high-resolution images without staining. It is the oldest and simplest type of microscope that creates an image by altering the wavelengths of light rays passing through the specimen. Altered wavelength paths are created using an annular stop in the condenser. The annular stop produces a hollow cone of...
Super-resolution Fluorescence Microscopy
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been developed.
Deconvolution
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Downsampling
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...

