PLY-SLAM: Semantic Visual SLAM Integrating Point-Line Features with YOLOv8-seg in Dynamic Scenes

In dynamic and low texture environments, traditional point-feature-based visual SLAM (vSLAM) often faces the challenges of poor robustness and low localization accuracy. To this end, this paper proposes a semantic vSLAM approach that fuses point-line features with YOLOv8-seg. First, we designed a high-performance 3D line-segment extraction method that determines the number of points to be sampled for each line-segment in terms of the length of the 2D line-segments extracted from the image, and back-projects these sampled points combined with the depth image to obtain the 3D point set of the line-segments. On this basis, accurate 3D line-segment fitting is realized in combination with the RANSAC algorithm. Subsequently, we introduce Delaunay triangulation to construct the geometric relationships between map points, detect dynamic feature points by matching changes in the topological structure of feature points in adjacent frames, and combine them with the instance labels provided by the YOLOv8-seg to accurately remove dynamic feature points. Finally, a loop-closure detection mechanism that fuses point-line features with instance-level matching is designed to calculate a normalized similarity score by combining the positional similarity of the instances, the scale similarity, and the spatial consistency of the static instances. A series of simulations and experiments demonstrate the superior performance of our method.