SOCA-PRNet:空间导向的注视注入的结构化功能启用的PoseResNet用于2D人类姿势估计
Ali Zakir1, Sartaj Ahmed Salman1, Hiroki Takahashi1,2
1Department of Informatics, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo 182-8585, Japan.
Sensors (Basel, Switzerland)
|January 11, 2024
概括
我们开发了SOCA-PRNet,这是一个新的深度学习模型,用于2D人类姿势估计 (HPE). 这种先进的方法提高了计算机视觉任务的准确性,如行为分析,即使在具有挑战性的条件下.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 2D人类姿势估计 (HPE) 对于理解计算机视觉 (CV) 中的人类行为至关重要.
- 深度学习已经推进了2D HPE,但阻塞和光线不良等挑战仍然存在.
- 优化2D HPE对于准确的关节识别和分类至关重要.
研究的目的:
- 引入面向空间的注重注入结构特征支持的PoseResNet (SOCA-PRNet) 进行增强的二维HPE.
- 为了提高2DHPE的准确性,而不会显著增加模型参数.
主要方法:
- 开发了SOCA-PRNet,将面向空间的注意力 (SOCA) 和全球上下文块 (GCB) 与ResNet34.4集成在一起.
- 采用深度学习用于自动特征学习和模型通用化.
主要成果:
- 在0.5 (PCKh@0.5) 的正确关键点百分比达到90.877,在50%的值.
- 获得了 41.137.7 的平均精度 (平均@0.1) 得分.
- 在经验评估中表现优于现有的最先进的方法.
结论:
- 在二维HPE中,SOCA-PRNet表现出卓越的性能.
- 该模型的效率和准确性显示了机器人,游戏和人机交互等现实应用的潜力.
更多相关视频
相关概念视频
Structural Classification of Joints
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
One-Degree-of-Freedom System
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
Absolute Motion Analysis- General Plane Motion
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the drone...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the drone...
Relative Motion Analysis using Rotating Axes
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
Neural Control of Respiration
The neural regulation of respiration is a meticulously coordinated process primarily controlled by the respiratory centers located within the brainstem. These centers, composed of specialized neurons, transmit nerve impulses that control the contraction and relaxation of our respiratory muscles.
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
Automatic Processing and Automatic Social Behavior
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...


