丰富的行动-语义一致的知识用于早期行动预测
概括
本研究引入了一种用于早期行动预测 (EAP) 的新方法,通过从视频段中挖掘行动语义一致知识 (ASCK). 拟议的RACK模型在多个基准上取得了最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 早期行动预测 (EAP) 对现实应用至关重要,但现有的方法往往忽视视频数据中的语义关系.
- 由于信息不完整,从部分视频序列中识别人类行为是一个重大挑战.
研究的目的:
- 为EAP开发一种新的方法,有效地利用不同部分视频段的语义一致性.
- 引入丰富的行动-语义一致的知识网络 (RACK) 以提高EAP的性能.
主要方法:
- 将视频分成部分,以在各种进度级别挖掘行动语义一致的知识 (ASCK).
- 使用教师-学生框架与双向和单向语义图表来建模ASCK.
- 采用双流预训练模型进行特征提取,并结合平均平方误差 (MSE) 和最大平均差异 (MMD) 的蒸损失.
主要成果:
- 拟议的RACK模型在利用EAP的ASCK方面表现出显著的有效性.
- 在三个基准数据集上实现了最先进的性能.
- 废弃性研究证实了丰富的ASCK建模的好处.
结论:
- 模拟行动-语义一致的知识是提高早期行动预测的高效策略.
- RACK网络为EAP提供了一个强大的框架,用于捕获视频数据中的复杂关系.
- 开发的方法为实际EAP应用提供了有希望的进步.
相关概念视频
Associative Learning
378
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
378
Fixed Action Patterns
16.0K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
16.0K
Action Potentials
131.1K
Overview
131.1K
Predicting Reaction Outcomes
8.4K
Kinetics describes the rate and path by which a reaction occurs. In contrast, thermodynamics deals with state functions and describes the properties, behavior, and components of a system. It is not concerned with the path taken by the process and cannot address the rate at which a reaction occurs. Although it does provide information about what can happen during a reaction process, it does not describe the detailed steps of what appears on an atomic or a molecular level. On the other hand,...
8.4K
Behaviorism
2.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.3K
Purposive Learning
121
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
121


