多模式和多尺度特征融合用于弱监督的视频异常检测检测
Wenwen Sun1,2, Lin Cao3,4, Yanan Guo5
1Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, 100192, China.
Scientific reports
|October 1, 2024
概括
这项研究引入了一种新的弱监督的视频异常检测方法,使用多模式和多尺度的功能. 该方法有效地处理视频模糊和屏蔽,在基准数据集上实现卓越的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 弱监督的视频异常检测使用视频级标签,没有分段边界.
- 现有的方法通常采用多个实例学习,但与视频模糊和屏蔽作斗争.
- 这些局限性阻碍了对异常事件的准确检测.
研究的目的:
- 开发一种新的弱监督视频异常检测方法.
- 为应对视频模糊和视觉屏蔽所带来的挑战.
- 提高异常检测系统的准确性和稳定性.
主要方法:
- 使用预先训练的I3D来提取RGB和光流特征 (外观和运动).
- 引入了注意力脱冗余 (AD) 模块来过不相关的功能.
- 开发了一个多尺度特征学习模块,用于时间依赖.
- 实现了适应性功能融合模块,以实现最佳的功能集成.
主要成果:
- 提出的方法显著优于现有的无监督和低监督方法.
- 在上海科技数据集上实现了97.00%的AUC.
- 在UCF-Crime数据集上实现了85.31%的AUC.
结论:
- 多模式和多尺度功能的融合增强了视频异常检测.
- 新的AD和自适应融合模块有效地解决了特征冗余和模式集成问题.
- 该方法在基准数据集上表现出强大的概括性和稳定性.
相关概念视频
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Classification of Signals
417
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
417
Functional Classification of Joints
3.9K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
3.9K
Structural Classification of Joints
3.2K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.2K
Deconvolution
138
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
138
Aggregates Classification
305
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
305


