DTCM:在视频中共同优化黑暗增强和动作识别
概括
我们介绍了黑暗时间一致性模型 (DTCM),这是一个端到端的框架,用于在黑暗视频中改进人为动作识别. DTCM联合优化暗色增强和动作识别,在准确性和效率方面超过现有方法.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 在低光条件下识别人类活动是一个关键但具有挑战性的任务.
- 目前用于暗视频分析的双阶段方法存在不一致的时间表示学习问题.
研究的目的:
- 开发一个新的端到端框架,用于联合暗增强和行动识别.
- 为了改善黑暗视频中的时间一致性,功能学习用于强大的动作识别.
主要方法:
- 提出了黑暗时间一致性模型 (DTCM),这是一个整合动作分类和黑暗增强的单阶段框架.
- 引入了使用RGB差异的时空一致性损失,以增强增强的视频中的时间一致性.
- 使用级联架构,以实现高效的关节优化.
主要成果:
- 在ARID (2.32%的增加) 和UAVHuman-Fisheye (4.19%的增加) 数据集上,DTCM实现了最先进的准确性.
- 证明了高效率,超过现有方法,GFLOP和参数明显减少.
- 通过改善各种行动识别模型 (TSM,I3D等) 的性能,展示了强大的概括性. ) 的情况.
结论:
- 通过有效地解决时间不一致性,DTCM提供了对暗视频动作识别的卓越方法.
- 该框架在低光作用识别任务的准确性,效率和通用性方面取得了重大进展.
相关概念视频
Light Acquisition
8.5K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.5K
Force Classification
1.3K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.3K
Muscle Coordination and Action
1.6K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
1.6K
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
Deconvolution
201
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
201
Extraction: Advanced Methods
497
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
497


