Application of 3D point cloud and visual-inertial data fusion in Robot dog autonomous navigation

The study proposes a multi-sensor localization and real-timeble mapping method based on the fusion of 3D LiDAR point clouds and visual-inertial data, which addresses the issue of decreased localization accuracy and mapping in complex environments that affect the autonomous navigation of robot dogs. Through the experiments conducted, the proposed method improved the overall localization accuracy by 42.85% compared to the tightly coupled LiDAR-inertial odometry method using smoothing and mapping. In addition, the method achieved lower mean absolute trajectory errors and root mean square errors compared to other algorithms evaluated on the urban navigation dataset. The highest root-mean-square error recorded was 2.72m in five sequences from a multi-modal multi-scene ground robot dataset, which was significantly lower than competing approaches. When applied to a real robot dog, the rotational error was reduced to 1.86°, and the localization error in GPS environments was 0.89m. Furthermore, the proposed approach closely followed the theoretical path, with the smallest average error not exceeding 0.12 m. Overall, the proposed technique effectively improves both autonomous navigation and mapping for robot dogs, significantly increasing their stability.