Leveraging learned monocular depth prediction for pose estimation and mapping on unmanned underwater vehicles

  • 0Autonomous Systems Lab, Institute of Robotics and Intelligent Systems, Department of Mechanical and Process Engineering, ETH, Zurich, Zurich, Switzerland.

|

|

Summary

This summary is machine-generated.

This study introduces a framework for Unmanned Underwater Vehicles (UUVs) to map underwater environments using visual and acoustic data. It achieves accurate real-time localization and 3D mapping for fish farming applications.

Area Of Science

  • Robotics and Automation
  • Underwater Systems Engineering
  • Computer Vision

Background

  • Complex underwater environments, especially fish farms, pose significant challenges for Unmanned Underwater Vehicle (UUV) navigation and mapping.
  • Accurate localization and 3D mapping are crucial for autonomous operations like inspection and navigation in these dynamic settings.

Purpose Of The Study

  • To develop a general framework integrating visual and acoustic sensor data for enhanced UUV localization and mapping.
  • To enable real-time net-relative pose estimation and depth prediction using solely visual data.
  • To achieve global pose estimation by fusing visual and acoustic data and generate detailed 3D maps.

Main Methods

  • Deep learning-based monocular depth prediction combined with Fast Fourier Transform (FFT)-based sparse depth priors for net-relative pose estimation.
  • Fusion of net-relative estimates with acoustic measurements for global UUV pose estimation.
  • Integration of predicted depth images into the wavemap framework for real-time 3D map generation.

Main Results

  • Accurate real-time estimation of UUV net-relative and global positions demonstrated in industrial-scale fish farm datasets.
  • Generation of detailed 3D maps suitable for autonomous navigation and inspection tasks.
  • Successful integration of visual and acoustic data for robust underwater perception.

Conclusions

  • The proposed framework effectively enhances UUV localization and mapping capabilities in challenging underwater environments.
  • The system provides accurate real-time positioning and 3D mapping essential for autonomous underwater operations in aquaculture.
  • This approach offers a significant advancement for UUV applications in dynamic and complex marine settings.

Related Concept Videos

Depth Perception and Spatial Vision 01:15

952

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.

Uniform Depth Channel Flow: Problem Solving 01:18

130

To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...

Uniform Depth Channel Flow 01:27

170

Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...

Buoyancy and Stability for Submerged and Floating Bodies 01:11

2.0K

In fluid mechanics, buoyancy and stability are key concepts for understanding the behavior of submerged and floating bodies. When a stationary body is fully or partially submerged in a fluid, the fluid exerts a force on the body known as the buoyant force. This force acts vertically upward through a point called the center of buoyancy, which is the center of the displaced fluid volume. According to Archimedes' principle, the magnitude of the buoyant force is equal to the weight of the fluid...