Edge_MVSFormer:基于变压器网络的边缘感知多视图立体设备重建
Yang Cheng1, Zhen Liu1, Gongpu Lan1
1Guangdong-Hong Kong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, School of Physics and Optoelectronic Engineering, Foshan University, Foshan 528000, China.
Sensors (Basel, Switzerland)
|April 12, 2025
概括
Edge_MVSFormer通过增强边缘细节来改善3D植物重建. 这种方法显著减少了深度图像和点云中的错误,这对于植物学研究至关重要.
科学领域:
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
- 植物学研究 植物学研究
背景情况:
- 使用RGB摄像头的多视图立体声 (MVS) 是一个具有成本效益的植物研究工具.
- 现有的MVS方法在植物纹理和细边缘重建方面扎,限制了准确性.
研究的目的:
- 为了提高MVS中植物叶边缘重建的准确性.
- 开发一种新的MVS模型,专注于植物应用的边缘信息.
主要方法:
- 拟议的Edge_MVSFormer,是基于TransMVSNet.net的内容构建的
- 集成了一个边缘检测算法,以提供边缘信息作为输入.
- 引入了边缘感知损失函数,以优先考虑边缘区域的准确性.
主要成果:
- 在深度图像中,边缘误差减少了2.20 ± 0.36毫米,整体误差减少了0.46 ± 0.07毫米.
- 在点云中,边缘误差减少了0.13 ± 0.02毫米,整体误差减少了0.05 ± 0.02毫米.
- 在10个试验模型工厂中表现出显著的改进.
结论:
- 边缘信息对于精确的工厂MVS数据重建至关重要.
- Edge_MVSFormer为植物学研究的MVS提供了实质性的进步.
- 该方法有效地解决了复杂的植物结构重建的局限性.
相关概念视频
Types Of Transformers
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
Deconvolution
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Transformers with Off-Nominal Turns Ratios
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the rated...


