JSSE:为零射击事件识别提供联合顺序语义编码器
Naveen Madapana1, Juan P Wachs1
1School of Industrial Engineering, Purdue University, West Lafayette, IN, 47906.
概括
本研究引入了使用语义属性的零射击事件识别 (ZSER) 的新方法. 拟议的联合顺序语义编码器 (JSSE) 模型有效地识别了像手势和动作这样的看不见的动态事件.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 零射击学习 (ZSL) 在识别看不见的对象类别方面表现出色,但在动态事件 (ZSER) 中未得到充分探索.
- 现有的ZSL研究主要侧重于静态对象识别,在理解动态事件识别方面存在差距.
- 从可见到不可见的事件类别转移知识需要超越静态对象识别的新方法.
研究的目的:
- 通过利用语义属性来解决零射击事件识别 (ZSER) 的挑战.
- 为ZSER研究引入第一个基于属性的手势数据集 (ZSGL).
- 为ZSER提出和评估一个端到端的模型,即联合序列语义编码器 (JSSE).
主要方法:
- 使用亚马逊机械土耳其人开发了ZSGL数据集,包含26个手势类别和65个属性.
- 使用可训练的循环网络和3D卷积神经网络 (CNN) 来提取时空特征.
- 为端到端的ZSER提出了联合顺序语义编码器 (JSSE) 模型,优化语义和分类任务.
主要成果:
- 与现有的基线相比,JSSE模型在四个实验条件 (类别内,跨类别,封闭集,开放集) 中表现优越.
- 对ZSGL,UCF和HMDB数据集的评估证实了JSSE在零射击事件识别方面的有效性.
- JSSE取得了有利的结果,在识别可见和不可见的动态事件方面表现优于其他方法.
结论:
- 拟议的JSSE模型通过使用语义属性为零射击事件识别提供了有效的解决方案.
- ZSGL数据集为推进基于属性的ZSER的研究提供了宝贵的资源.
- 这项工作突出了语义属性转移在零射击环境中识别动态事件的潜力.
相关概念视频
Per-Unit Sequence Models
74
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
74
Chunking and Rehearsal in Sensory Memory
217
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
217
Associative Learning
399
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
399
Signal Sequences and Sorting Receptors
5.4K
Signal sequences are short amino acid sequences that guide newly synthesized proteins to their proper location within the cell. Classical signal sequences are fifteen to sixty amino acids long and present at the N-terminus of a polypeptide chain. Each signal sequence has a conserved segment of basic residues towards their N terminus, a hydrophobic core, and a C-terminus rich in polar residues. The C-terminus also contains a signal cleavage site and features a -3 -1 sequence motif. The -3-1...
5.4K
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Maxam-Gilbert Sequencing
11.2K
In the same year as the discovery of the Sanger sequencing method, another group of scientists, Allan Maxam and Walter Gilbert, demonstrated their chemical-cleavage method for DNA sequencing. The Maxam-Gilbert method relies on using different chemicals that can cleave the DNA sequence at specific sites, the separation of resulting DNA fragments of variable size using electrophoresis, and deciphering the DNA sequence from the resulting gel bands.
Challenges of the Maxam-Gilbert Method
The...
Challenges of the Maxam-Gilbert Method
The...
11.2K


