视频场景检测使用变压器编码链接器网络 (TELNet)
Shu-Ming Tseng1, Zhi-Ting Yeh2, Chia-Yang Wu1
1Department of Electronic Engineering, National Taipei University of Technology, Taipei 106335, Taiwan.
Sensors (Basel, Switzerland)
|August 26, 2023
概括
本研究介绍了TELNet,这是一个用于自动视频场景边界检测的新型网络. 它通过链接编码的视频拍摄功能,有效地识别场景变化,实现最先进的性能和长视频的线性可扩展性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 场景边界检测对于视频分析任务如总结至关重要.
- 现有的方法往往需要对视频结构的先验知识.
- 准确的场景细分有助于组织和理解视频内容.
研究的目的:
- 引入一种新的深度学习模型,即变压器编码链接器网络 (TELNet),用于无监督的视频场景边界检测.
- 开发一种有效的方法来识别场景过渡,而不依赖于预定义的视频结构.
- 为了提高视频中自动场景检测的性能和可扩展性.
主要方法:
- 使用了变压器编码链接器网络 (TELNet) 架构.
- 采用滚动窗口方法来顺序处理视频镜头.
- 使用微调的3D卷积神经网络 (CNN) 提取镜头特征,并用变压器编码器编码它们.
- 在连续的镜头特征之间建立联系,使用链接器组件来识别不连续性.
主要成果:
- 在标准视频场景检测基准中,TELNet的性能与最先进的模型相美.
- 在交叉数据集评估中显示显著改善的结果 (F-score),表明强烈的概括性.
- 在视频拍摄数量方面表现出线性计算复杂性,确保长视频的效率.
结论:
- 泰尔网为自动视频场景边界检测提供了有效和高效的解决方案.
- 该模型的无监督性和跨数据集的强大性能凸显了其实际适用性.
- TELNet的线性可扩展性使其适合处理大规模的视频档案和实时应用程序.
相关概念视频
01:27Transformers in Distribution System
123
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
123
01:16Types Of Transformers
1.0K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.0K
01:26The Ideal Transformer
423
In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
423
01:24Sequence Networks of Rotating Machines
123
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
123
01:26Transformers
1.1K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.1K
01:25Transformers with Off-Nominal Turns Ratios
176
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
176