OM-VST:一个基于优化下采样模块的视频动作识别模型,与多尺度特征融合相结合.
Xiaozhong Geng1, Cheng Chen2, Ping Yu1
1Changchun Institute of Technology, Changchun, Jilin, China.
PloS one
|March 6, 2025
概括
该OM-视频旋转变压器 (OM-VST) 模型提高了2.81%的视频分类精度,并减少了54.7%的模型参数. 这种优化的模型解决了计算机视觉方面的挑战,以实现更高效,更精确的视频内容识别.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 目前的视频分类模型由于复杂的视频数据和高参数数量而难以准确.
- 挑战包括微妙的类别差异,背景噪音和照明变化,导致不理想的性能.
- 高参数计数导致训练时间延长和能源消耗增加.
研究的目的:
- 引入一个改进的视频分类模型,OM-Video Swin变压器 (OM-VST).
- 为了增强功能感知和特征表征能力,以便更准确地进行视频分析.
- 为了减少视频分类任务中的模型复杂性和计算开销.
主要方法:
- 开发了OM-Video Swin变压器 (OM-VST) 通过集成一个多尺度特征融合模块和一个优化下采样模块.
- 基于现有的视频旋转变压器 (VST) 架构构建.
- 在公共数据集上对VST,SlowFast和TSM等主流模型进行比较实验.
主要成果:
- 与现有模型相比,OM-VST模型在分类准确度方面实现了2.81%的改进.
- 显著减少了54.7%的模型参数数量.
- 在准确识别和标记视频内容方面表现出卓越的性能.
结论:
- OM-VST模型有效地解决了当前视频分类方法的局限性.
- 实现更高的准确性和更高的效率,使其适合实际应用.
- 在自动化视频内容分析和理解方面提供了有前途的进步.
相关概念视频
Downsampling
120
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
120
Upsampling
182
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
182
Deconvolution
127
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
127
Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K
Extraction: Advanced Methods
398
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
398
Super-resolution Fluorescence Microscopy
6.8K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
6.8K


