交叉模式同步 (CrossModalSync):用于大规模场景中的语义场景分割的联合时空融合
Shuyi Tan1, Yi Zhang2, Yan Li3
1College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China.
Scientific reports
|July 14, 2025
概括
这项研究引入了点云语义细分的新框架,提高了自动驾驶汽车的准确性和效率. 该方法通过整合时间对齐,多尺度卷积和优先点保留来有效处理复杂的场景.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
背景情况:
- 点云语义细分对于在复杂环境中导航的自动驾驶汽车至关重要.
- 现有的方法在动态场景中扎着累积错误和信息丢失.
研究的目的:
- 开发一个框架,平衡点云语义细分的准确性和效率.
- 为了应对诸如累积错误和"许多对一个"映射问题等挑战.
主要方法:
- 使用时间对齐 (TA) 和投影多尺度卷积 (PMC) 来捕捉框架间的相关性和局部细节.
- 采用优先点保留 (PPR) 来保存关键的3D信息并减轻"许多对一个"映射问题.
- 整合LiDAR和摄像头数据通过多式联络融合,以增强感知.
主要成果:
- 在SemanticKITTI和nuScenes数据集上实现了最先进的性能.
- 与现有方法相比,证明了更好的准确性和计算效率.
- 在复杂的场景中成功检测到封闭的物体和动态实体.
结论:
- 拟议的框架为自动驾驶中的点云语义细分提供了一个强大的解决方案.
- TA,PMC,PPR和多模式融合的组合显著提高了细分性能.
- 该方法显示了在自主系统中的真实应用的巨大潜力.
相关概念视频
Structural Classification of Joints
4.2K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
4.2K
Functional Classification of Joints
4.9K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.9K
Depth Perception and Spatial Vision
944
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
944
Relative Motion Analysis using Rotating Axes
539
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
539
Relative Motion Analysis using Rotating Axes-Problem Solving
451
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
451
Collisions in Multiple Dimensions: Problem Solving
4.4K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.4K


