Uncertainty-constrained fusion of single-view and multi-view depth estimation for AR virtual-real occlusion
These videos have been matched automatically. Contact us if they are not relevant.
These videos have been matched automatically. Contact us if they are not relevant.
View abstract on PubMed
Summary
This summary is machine-generated.This study introduces a novel hybrid depth estimation algorithm for augmented reality (AR) to improve virtual-real occlusion. The method enhances depth accuracy in complex scenes, leading to more realistic AR interactions.
Area Of Science
- Computer Vision
- Augmented Reality
- Computer Graphics
Background
- Virtual-real occlusion is a key challenge in augmented reality (AR), impacting realism and immersion.
- Depth-based methods offer real-time AR potential but require accurate depth estimation, which is difficult in complex scenarios.
- Existing depth estimation algorithms struggle with performance degradation in interactive and complex environments.
Purpose Of The Study
- To design a robust depth estimation algorithm tailored for complex AR environments.
- To improve the accuracy and stability of occlusion handling between virtual objects and the physical world in AR.
- To enhance user immersion and interaction realism in augmented reality applications.
Main Methods
- A hybrid depth estimation algorithm integrating single-view and multi-view cues was developed.
- The model incorporates a single-view encoder to augment multi-view cost volumes and a Bayesian convolution-based uncertainty module.
- A dynamic mask generated by the single-view branch mitigates the impact of scene dynamics on depth estimation.
Main Results
- The proposed method achieved a 23.9% reduction in AbsRel and a 28% reduction in RMSE compared to the SimpleRecon baseline on ScanNet v2.
- Accuracy metrics (δ 1) improved by 5.43 percentage points, indicating enhanced depth prediction reliability.
- Boundary Intersection over Union (IoU) for AR occlusion assessment increased by 7.13%, demonstrating sharper and more dependable occlusion handling.
Conclusions
- The hybrid depth estimation algorithm effectively addresses virtual-real occlusion challenges in complex AR scenes.
- The integration of single-view and multi-view cues, along with uncertainty suppression, significantly improves depth estimation accuracy.
- The method provides more reliable depth data and sharper occlusion handling, advancing the realism of augmented reality experiences.
These videos have been matched automatically. Contact us if they are not relevant.
These videos have been matched automatically. Contact us if they are not relevant.
Related Concept Videos
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...