循环ACR:用于视频行动检测的行为者-上下文关系的循环建模
概括
这项研究引入了一个新的循环演员-上下文关系网络 (CycleACR),通过更好地建模演员-场景关系来改善视频动作检测. 循环ACR通过适应性地重组上下文特征和增强行为体表示来实现最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 由于复杂的演员互动和场景背景,视频动作检测具有挑战性.
- 现有的方法在关系建模中扎着场景变化和背景干扰.
- 对演员与场景关系的有效建模对于准确的动作识别至关重要.
研究的目的:
- 提出一个新的网络,循环行为者-上下文关系 (CycleACR),以改进视频动作检测.
- 通过选择与演员相关的场景背景而不是原始视频数据来增强关系建模.
- 为了在视频动作检测方面实现最先进的性能.
主要方法:
- 开发了一个循环行为者-上下文关系 (CycleACR) 网络,用于双向行为者-上下文关系建模的对称图形.
- 介绍了参与者对背景重组 (A2C-R) 和背景对参与者增强 (C2A-E) 模块.
- 整合了并行本地/全球时间上下文建模和上下文意识的内存库.
主要成果:
- 在AVA (40.6 mAP) 和UCF101-24 (84.7 mAP) 数据集上实现了最先进的性能.
- 证明了建议的A2C-R模块对关系建模的有效性.
- 废除研究和可视化证实了循环演员-上下文关系建模的改进.
结论:
- 拟议的CycleACR网络通过有效的行为者-上下文关系建模,显著提升了视频动作检测.
- 新的A2C-R模块是改善上下文特征重组和演员特征增强的关键.
- 该方法提供了一个强大的方法来捕捉视频数据中的高阶关系和时间依赖.
更多相关视频
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
15.8K
08:25Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
Published on: May 7, 2019
9.1K
相关概念视频
Fixed Action Patterns
16.5K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
16.5K
Relative Motion Analysis using Rotating Axes
533
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
533
Masking and Demasking Agents
2.7K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.7K
Relative Motion Analysis - Acceleration
426
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
426
