使用3D深度卷曲和视觉注意力的射击边界检测
Miguel Jose Esteve Brotons1, Francisco Javier Lucendo1, Rodriguez-Juan Javier2
1Telefónica I+D, 28050 Madrid, Spain.
Sensors (Basel, Switzerland)
|August 26, 2023
概括
本研究介绍了一种更有效的方法,用于视频拍摄边界检测,使用深度可分离的卷积和视觉自我注意. 这种方法可以减少计算负载,同时保持流媒体应用程序的高精度.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 视频处理 视频处理
背景情况:
- 拍摄边界检测对于视频分析和场景细分至关重要.
- 3D卷积网络擅长用于此任务的时空特征提取.
- 3D卷曲的高计算成本阻碍了实时应用.
研究的目的:
- 开发一个计算效率高的射击边界检测模型.
- 为了提高视频分段速度,直播和近直播流媒体服务.
- 为了减轻3D卷积网络的参数和资源需求.
主要方法:
- 利用深度可分离的卷积来减少模型参数.
- 实施了一个用于卷积网络的参数减小的新方案.
- 集成的视觉自我注意力机制以提高性能.
主要成果:
- 与标准3D卷曲相比,模型参数显著减少.
- 对于深度可分离卷积的有效性证明,用于射线边界检测.
- 视觉自我注意力补偿了潜在的性能下降.
结论:
- 拟议的方法为实时射击边界检测提供了一个有效的替代方案.
- 这种方法适用于增强流媒体平台的用户体验.
- 将深度可分离的卷曲与自我注意力结合在一起是一个有希望的方向.
相关概念视频
Depth Perception and Spatial Vision
714
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
714
Uniform Depth Channel Flow: Problem Solving
85
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
85
Uniform Depth Channel Flow
95
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
95
Sight Distance in a Vertical Curve
75
Sight distance on vertical curves is critical in roadway design. It ensures drivers can see far enough ahead to identify and respond to hazards effectively. This directly impacts safety, driver comfort, and the overall efficiency of the transportation network.Vertical curves are classified into crest and sag curves based on their geometry. For crest curves, sight distance is determined by the line of sight between a driver's eye and a small object on the road's surface. Design parameters for...
75
Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K


