语言引导的3D行动特征 没有基础真相的学习 样本 课堂标签 标签
概括
本研究介绍了自主监督的3D动作特征学习 (S3AFL),使用文本监督来改进点云序列分析. 这种方法显著缩小了与基于骨架的三维人类行动识别方法的性能差距.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 从点云序列的3D动作识别落后于基于骨架的方法.
- 利用跨模式监管是弥合这一差距的一个有希望的方向.
研究的目的:
- 从点云序列引入自主监督的3D动作特征学习 (S3AFL) 的文本弱监督.
- 为了缩小点云和基于骨架的3D动作识别之间的性能差异.
主要方法:
- 使用RGB点云对,通过图像标题从RGB生成文本,以进行弱监控.
- 采用跨模式和内部模式的对比学习 (CL) 与多阶段的语义改进.
- 引入了多级最大共享 (MR-MP) 功能,以增强点集特征表示.
主要成果:
- 在NTU RGB+D 60上实现了高达10.8%的性能增长,在NTU RGB+D 120上达到10.4%,在N-UCLA上达到8.0%.
- 显著减少了点云序列和基于骨架的动作识别方法之间的性能差距.
- 证明了基于文本的弱监督转移到基于骨架的方法的普遍性.
结论:
- 基于文本的弱监督有效地增强自主监督的3D动作特征从点云序列学习.
- 拟议的S3AFL框架与MR-MP提供了一种针对细粒度动作识别的强有力的方法.
- 跨模式转移学习策略显示了人类行动分析未来研究的广泛适用性和潜力.
相关概念视频
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Associative Learning
335
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
335
Functional Classification of Joints
4.0K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.0K
Structural Classification of Joints
3.3K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.3K
Purposive Learning
117
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
117


