视频动作识别通过PSO-ConvNet变压器通过动态进行协作学习
Huu Phong Nguyen1, Bernardete Ribeiro2
1CISUC, Department of Informatics Engineering, University of Coimbra, Coimbra, Portugal. phong@dei.uc.pt.
Scientific reports
|September 5, 2023
概括
本研究引入了一个动态的PSO-ConvNet模型,通过将卷积神经网络与时间方法相结合,改善视频中的人类行动识别 (HAR). 这种新的方法提高了对人类行为进行分类的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 模式识别 模式识别
背景情况:
- 人类动作识别 (HAR) 具有挑战性,因为需要进行时间特征分析,而标准的卷积神经网络 (ConvNets) 却很难做到这一点.
- 现有的方法往往无法捕捉动态,时间方面至关重要,以准确的视频为基础的行动分类.
研究的目的:
- 提出一种新的动态粒子优化-卷积神经网络 (PSO-ConvNet) 模型,用于在视频序列中增强人类动作识别 (HAR).
- 将ConvNets与高级时间模型 (如变压器和循环神经网络) 集成,以捕捉时空动态.
- 在拟议的框架内评估协作学习的有效性.
主要方法:
- 开发了一个动态的PSO-ConvNet模型,其中神经网络重量作为相位空间中的粒子位置,促进共享学习.
- 集成的ConvNets与变压器和循环神经网络架构,以处理视频中的时间信息.
- 采用协作学习策略,将其与个人学习范式进行比较.
主要成果:
- 在UCF-101数据集上实现了高达9%的显著精度改进.
- 在Kinetics-400和HMDB-51等较大的数据集上,协作学习的表现优于个人学习.
- 验证了模型在捕捉HAR的时空动态方面的有效性.
结论:
- 动态的PSO-ConvNet模型通过有效地将卷积神经网络与时间建模集成,为人类行动识别提供了有希望的进步.
- 在PSO-ConvNet框架内的协作学习显著提高了HAR任务的性能.
- 拟议的方法提供了一个强大的解决方案,用于分析复杂的人类行为在视频序列.
相关概念视频
Observational Learning
209
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
209
Relative Motion Analysis using Rotating Axes-Problem Solving
421
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
421
Relative Motion Analysis using Rotating Axes
486
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
486
Associative Learning
439
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
439
Introduction to Learning
470
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
470
Relative Motion Analysis - Velocity
388
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
388


