一个多模态的自我中心活动识别方法向视频领域的概括
Antonios Papadakis1, Evaggelos Spyrou2
1Department of Informatics and Telecommunications, National Kapodistrian University of Athens, 15772 Athens, Greece.
Sensors (Basel, Switzerland)
|April 27, 2024
概括
这项研究引入了一种使用可穿戴相机识别自我中心活动的新方法. 该方法有效地预测了视频中的人类行为,通过简单的数据调整和全新的深度神经网络,优于现有方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人与计算机的交互
背景情况:
- 使用可穿戴相机的自我中心活动识别受到视频中的复杂身体运动的挑战.
- 现有的方法通常需要大量的训练数据或复杂的无监督域调整技术来处理数据差异.
研究的目的:
- 为自我中心的人类活动识别提出一种新的,域普遍化的方法.
- 开发能够准确预测人类活动的强大模型,以自我中心的视频序列与最小的目标领域参与.
主要方法:
- 一个新的三流深度神经网络架构的介绍.
- 视觉转换器和残余神经网络的集成.
- 使用多模式数据训练网络,并进行简单的源域数据操作.
主要成果:
- 在最近的最先进的研究工作中表现出优越性.
- 在具有挑战性的自我中心视频数据集中实现了强大的人类活动预测.
- 展示了简单的数据操纵和最小的目标域参与的有效性.
结论:
- 拟议的方法提供了一个更高效和有效的解决方案,用于域普用自我中心活动的认可.
- 新的三流网络架构为分析自我中心视频数据提供了强大的框架.
- 这种方法通过简化基于可穿戴相机的活动识别领域的适应挑战来推动该领域的进步.
相关概念视频
Generalization, Discrimination, and Extinction
540
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
540
Observational Learning
168
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
168
Stereotype Content Model
14.7K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.7K
Associative Learning
345
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
345
Masking and Demasking Agents
2.4K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.4K


