事件融合光度立体网络的立体网络.
Wonjeong Ryoo1, Giljoo Nam2, Jae-Sang Hyun3
1Department of Artificial Intelligence, Korea University, Seoul, 02841, South Korea.
概括
本研究介绍了事件融合光度立体网络 (EFPS-Net),它结合了RGB和事件摄像头,以准确地估计环境光下表面的正常值. 这种新的方法克服了RGB相机的局限性,提高了光度立体精度.
科学领域:
- 计算机视觉 计算机视觉
- 计算成像技术的成像
- 机器人技术 机器人技术 机器人技术
背景情况:
- 光度立体声传统上使用RGB摄像机在受控的黑暗环境中.
- 由于有限的RGB相机动态范围,环境照明挑战了传统方法.
- 准确的表面正常估计对于3D重建和分析至关重要.
研究的目的:
- 利用RGB和事件摄像头开发一种用于估计环境照明下的表面正常值的新方法.
- 利用事件摄像机的高动态范围来克服RGB摄像机在光度立体的局限性.
- 在不受约束的照明条件下提高光度立体声的精度和稳定性.
主要方法:
- 提出了事件融合光度立体网络 (EFPS-Net),集成RGB和事件摄像头数据.
- 开发了一种事件插值技术,以增强光线信息捕获.
- 创建了合并的RGB事件观测地图,用于表面正常估计.
主要成果:
- EFPS-Net显著优于仅依赖RGB的最先进方法.
- 与现有方法相比,平均平均误差减少了7.94%.
- 在不同的环境光照环境中证明了有效的表面正常估计.
结论:
- 在具有挑战性的环境照明下,EFPS-Net为光度立体声提供了强大的解决方案.
- RGB和事件摄像头数据的融合提高了表面正常估计的准确性.
- 为环境光照度立体声编制了一个新的数据集,促进了未来的研究.
相关概念视频
Flame Photometry: Overview
659
Flame photometry, also known as flame emission spectrometry, is a technique used for the qualitative and quantitative analysis of elements present in a sample using a flame as the source of excitation energy. The concept of flame photometry was realized in the early 1860s by Kirchhoff and Bunsen, who discovered that specific elements emit characteristic radiation when excited in flames. The first instrument developed for this purpose was used to measure sodium (Na) in plant ash using a Bunsen...
659
Flame Photometry: Lab
274
In a flame photometer, when a solution like potassium chloride is aspirated into the flame, the solvent evaporates, leaving behind dehydrated salt. This salt dissociates into free gaseous atoms in their ground state. Some of these atoms absorb energy from the flame, leading to their excitation. The excited atoms return to the ground state, emitting photons at characteristic wavelengths. Because only electronic transitions are involved, the resulting emission lines are very narrow. The intensity...
274
Attenuated Total Reflectance (ATR) Infrared Spectroscopy: Overview
415
Attenuated total reflectance (ATR) infrared spectroscopy is a powerful analytical technique used to study the composition of materials. It is widely employed in chemistry, materials science, forensic science, and other fields where sample characterization is required. ATR has several advantages over traditional transmission IR spectroscopy, including the requirement of little to no sample preparation and the ability to analyze a wide range of samples.
The ATR process begins by directing a beam...
The ATR process begins by directing a beam...
415
Light Acquisition
8.5K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.5K
Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K
Deconvolution
186
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
186


