STADe:通过时光光谱表示学习感知时间动作检测.
概括
我们介绍了传感器时间动作检测 (STADe) 模型,用于分析传感器数据,克服不同的采样率等挑战. 在检测复杂的感官序列中的行为方面,STADe显著优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 物联网的物联网,就是物联网.
- 传感器数据分析数据分析
背景情况:
- 时间动作检测 (TAD) 传统上专注于视频数据.
- 将TAD扩展到传感器数据提出了挑战:不同的采样速率,复杂的模式和噪声.
- 现有的TAD模型与感官信号的独特特征作斗争.
研究的目的:
- 提出一种新型模型,感觉时空动作检测 (STADe),用于有效地检测传感器数据中的动作.
- 解决当前TAD方法在应用于各种感觉信号时的局限性.
- 为了促进基于传感器的时间动作检测的未来研究.
主要方法:
- STADe使用富里埃内核和自适应频率过来捕获时间和频率特征.
- 采用多个分辨率和尺度的深度融合,以适应各种数据.
- 介绍了行动类别内双向和时间依赖的交叉级别预测器.
主要成果:
- 与最先进的TAD模型相比,STADe在感觉数据上的表现优越.
- 实验对一个公共和三个新建立的多样化的传感器数据集进行了实验.
- 该模型有效地处理传感信号固有的不同采样速率和作用持续时间.
结论:
- 拟议的STADe模型为传感器数据中的时间动作检测提供了一个强大的解决方案.
- STADe的自适应机制使其适用于各种传感器类型和数据特性.
- 已建立的数据集将成为推动感官TAD研究的宝贵资源.
相关概念视频
Auditory Pathway
5.8K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.8K
What is a Sensory System?
96.6K
Sensory systems detect stimuli—such as light and sound waves—and transduce them into neural signals that can be interpreted by the nervous system. In addition to external stimuli detected by the senses, some sensory systems detect internal stimuli—such as the proprioceptors in muscles and tendons that send feedback about limb position.
96.6K
Sensory Memory
313
Sensory memory captures information from the environment in its original form for a very brief duration, just long enough to be exposed to visual, auditory, and other senses. This type of memory is detailed and rich but quickly lost unless certain strategies are employed to transfer it into short-term or long-term memory. Sensory information is continuously bombarding the human brain, yet only a small fraction is absorbed, as most of it does not significantly impact daily life. For instance,...
313
Perceiving Loudness, Pitch, and Location
442
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
442
Discrete Fourier Transform
421
The Discrete Fourier Transform (DFT) is a fundamental tool in signal processing, extending the discrete-time Fourier transform by evaluating discrete signals at uniformly spaced frequency intervals. This transformation converts a finite sequence of time-domain samples into frequency components, each representing complex sinusoids ordered by frequency. The DFT translates these sequences into the frequency domain, effectively indicating the magnitude and phase of each frequency component present...
421
Hearing
53.1K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
53.1K


