精细的视听事件定位
IEEE transactions on neural networks and learning systems
|September 4, 2025
概括
本研究引入细粒度视听事件本地化 (AVEL) 以进行详细的事件识别. 一个新的数据集 (IT-AVE) 和方法 (SVED) 已经开发出来,显示出在微妙的视听事件区分方面有所改善.
科学领域:
- 计算机视觉
- 机器学习
- 信号处理
背景情况:
- 现有的视听事件本地化 (AVEL) 主要集中在粗的事件上.
- 区分细粒度事件对于专家应用和内容生成至关重要,但由于它们的微妙性,仍然具有挑战性.
- 需要专门的数据集和方法来解决细粒度AVEL的复杂性.
研究的目的:
- 建立一个新的研究方向在细粒度的视听事件本地化.
- 引入首个专门为细粒AVEL (IT-AVE) 设计的数据集.
- 提出一种新的方法 (SVED),能够定位难以察觉且易受干扰的细粒度事件.
主要方法:
- 构建IT-AVE数据集,其中包括13千段音乐片段和52千场音乐乐器表演,由专业人士用精细的演奏技术进行注释.
- 空间时间视频事件探测器 (SVED) 的开发,以应对检测微妙和干扰细粒度事件的挑战.
- 使用IT-AVE和现有数据集的细粒度版本进行实验验证 (UnAV-22,FineAction-AV).
主要成果:
- 拟议的SVED方法在细粒度的视听事件定位方面表现出有效性.
- 实验证实了IT-AVE数据集对于评估细粒度AVEL方法的有用性.
- 比较结果强调了新方法与相关数据集的基线方法相比的优势.
结论:
- 开发的IT-AVE数据集和SVED方法推进了细粒度视听事件本地化领域.
- 这项工作为未来对综合视听理解的研究提供了基础,特别是对细微事件的检测.
- 这些发现表明,在需要精确事件识别的专业领域,有提高性能的潜力.
相关概念视频
Perceiving Loudness, Pitch, and Location
419
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
419
Design Example: Identifying the Locations of Monuments in the Field Using Global Positioning System Device
168
Surveyors use Global Positioning System (GPS) technology to measure the precise location and elevation of points on Earth. In a recent survey, GPS receivers were used to determine the coordinates and elevations of two park monuments. The process involved careful mission planning, data collection, and correction to ensure accuracy. The survey began with mission planning to identify optimal satellite visibility and minimize Position Dilution of Precision (PDOP). A geodetic control point...
168


