对立体匹配和光学流量估计的合成到真实传输稳定性的研究
概括
本研究介绍了DKT和DKT++框架,用于在现实世界中微调时保持立体声匹配和光流网络的稳定性. 通过使用伪标签平衡学习区域,这些方法可以防止在看不见的领域的性能下降.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 对立体匹配和光流的深度学习模型,在合成数据上进行预训练,表现出对新领域的稳定性.
- 将这些模型微调到真实世界的数据上往往会导致这种强度的显著损失.
研究的目的:
- 调查微调立体声匹配和光流网络的方法,而不会牺牲它们的稳定性.
- 为了解决基底真理 (GT) 与伪标签 (PL) 地区的不平衡学习造成的强度退化.
主要方法:
- 提出了DKT框架,利用PL在GT中平衡一致和不一致的区域之间的学习.
- 引入了指数移动平均 (EMA) 教师,以根据学生网络进度动态调整学习区域.
- 开发了DKT++与慢速更新教师,以实现更准确的PL生成,并纳入未标记和合成数据.
主要成果:
- 证明GT和PL区域之间的不平衡学习是强度退化的一个关键因素.
- 展示了DKT和DKT++框架在微调过程中有效地保持立体声匹配和光流网络的稳定性.
- 在与最先进的网络集成时,对多个现实世界数据集验证了拟议框架的有效性.
结论:
- DKT和DKT++框架提供了一种可行的解决方案,用于在微调时保持网络稳定性,用于立体声匹配和光流任务.
- 通过伪标签来平衡学习区域对于保持现实应用中的概括能力至关重要.
相关概念视频
Uniform Depth Channel Flow: Problem Solving
131
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
131
Improving Translational Accuracy
2.7K
2.7K
Uniform Depth Channel Flow
172
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
172
Residuals and Least-Squares Property
7.9K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.9K
Relative Motion Analysis using Rotating Axes
549
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
549
Linear Approximation in Frequency Domain
137
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
137


