语义和时间上下文相关联学习对弱监督的时间行动定位的学习
概括
这项研究引入了一个用于弱监督时间动作定位 (WSTAL) 的新网络,该网络可以准确地发现动作类别并将它们定位在视频中. 语义和时间上下文相关学习网络 (STCL-Net) 提高了基准指标的表现.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 弱监督时间动作定位 (WSTAL) 仅使用视频级标签识别和定位视频中的动作.
- 关键的挑战包括准确地发现动作类别和精确地定位未经修剪的视频中的动作实例.
研究的目的:
- 通过提出一个新的网络,共同建模语义和时间上下文相关性来解决现有的WSTAL方法的局限性.
- 通过统一的动态关联嵌入模式,实现准确的动作发现和完整的动作本地化.
主要方法:
- 介绍了语义和时间上下文相关联学习网络 (STCL-Net),包括语义相关联学习 (SCL) 和时间上下文相关联学习 (TCL) 模块.
- 这些模块为每个片段建模视频内部和视频内部的相关性,从而实现共同的语义和时间理解.
主要成果:
- 在多个基准测试中,STCL-Net与最先进的模型相比,表现优越或可比.
- 取得了显著的改进,包括THUMOS-14数据集的平均平均精度 (mAP) 增加了7.2%.
结论:
- 拟议的STCL-Net通过共同建模语义和时间上下文相关性,有效地解决了WSTAL中的挑战.
- 废弃研究证实了STCL-Net架构中的单个组件的有效性和稳定性.
相关概念视频
Associative Learning
461
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
461
Observational Learning
225
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
225
Relative Motion Analysis using Rotating Axes
490
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
490
Chunking and Rehearsal in Sensory Memory
251
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
251
Relative Motion Analysis - Acceleration
385
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
385
Propagation of Action Potentials
6.0K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
6.0K


