使用基于物理的噪声模型和噪声脱网络的MSFA图像剥离
IEEE transactions on pattern analysis and machine intelligence
|September 16, 2025
概括
研究人员开发了一种新的基于物理的噪声模型和一个与噪声脱的神经网络,用于多谱波器阵列 (MSFA) 图像消噪. 这种方法有效地合成了现实的噪音图像,并消除了复杂的噪音,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 计算成像技术的成像
背景情况:
- 多光谱波器阵列 (MSFA) 摄像机提供了紧的尺寸和速度,但由于窄带成像而遭受噪声.
- 现有的神经网络拒绝方法需要高质量的配对噪音清洁数据集,这些数据集无法用于MSFA成像.
- 准确的噪声建模对于训练有效的MSFA无声算法至关重要.
研究的目的:
- 开发基于物理的噪声模型,用于为MSFA无声化生成现实的噪声图像.
- 设计一种新的噪声脱神经网络架构,以实现高效的MSFA图像消噪.
- 用现实世界MSFA数据集验证拟议的模型和网络.
主要方法:
- 创建了一个基于物理的噪声模型,区分简单的 (高斯式,波桑式) 和复杂的 (色偏差) 噪声组件.
- 设计了一个噪声脱网络,包括SimpleDist消除噪声网络 (SNRNet) 和ComplexDist消除噪声网络 (CNRNet).
- 在CNRNet中引入了可学习位置嵌入,以解决非统一的颜色偏差噪声.
主要成果:
- 拟议的噪音模型准确地合成了现实的噪音MSFA图像.
- 在合成数据上训练的噪声脱网络实现了与在真实配对数据上训练相匹配的性能.
- 开发的方法在实验中超越了最先进的染技术.
结论:
- 基于物理的噪声模型有效模拟MSFA噪声特征.
- 噪声脱网络为MSFA图像消除噪声提供了强大的解决方案,即使实际数据有限.
- 这项工作使MSFA在低光条件下能够获得高质量的图像.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
292
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
292
Modeling with Differential Equations
20
Population dynamics can be described mathematically by considering the population size P(t) as a function of time. The rate of change of the population is then represented by the derivative of P(t). A simple assumption is that the rate of growth is proportional to the size of the population itself. This leads to an exponential growth model, where the population increases rapidly without bound. While this is a useful first approximation, it does not reflect realistic long-term...
20


