在伪标签中抵抗噪声:可听视频事件解析与证据学习
概括
这项研究引入了一种用于视听视频解析 (AVVP) 的新框架,该框架使用证据深度学习 (EDL) 来克服杂的伪标签. 耐噪音事件解析 (NREP) 方法改善了视频中的时间事件感知和模式歧视.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 视听视频解析 (AVVP) 对于多模式视频理解至关重要.
- 现有的弱监督的AVVP方法与不可靠的伪标签 (PLs) 和时间模两可.
- 杂的PL和缺乏时间注释阻碍了准确的事件定位和模式歧视.
研究的目的:
- 提出一个新的AVVP框架,耐噪音事件解析 (NREP),解决噪音伪监督的局限性.
- 为了提高伪标签的可靠性,并改善AVVP任务中的时间定位.
- 为了在视听视频解析中实现最先进的性能.
主要方法:
- 引入了证据深度学习 (EDL),以减轻噪音的伪监督.
- 开发了模式依据的证据学习 (MEL) 用于模式-类依赖歧视.
- 实施了前景探索和前景背景一致性学习 (FBCL) 的时间依据证据学习 (TEL).
主要成果:
- 该NREP框架有效地抑制了来自产生的PLs的噪声干扰.
- 在不同的PL生成策略中实现了显著的性能改进.
- 在两个AVVP基准数据集上建立了新的最先进的结果.
结论:
- 拟议的NREP方法,利用EDL,为AVVP提供了一个强大的解决方案.
- 在多式联络视频理解中,NREP成功地处理了杂的伪标签和时间模糊性.
- 该框架显示了持续的绩效增长,并为该领域设定了新的基准.
相关概念视频
Perceiving Loudness, Pitch, and Location
182
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
182
Chunking and Rehearsal in Sensory Memory
133
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
133
Censoring Survival Data
55
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
55
Difference from Background: Limit of Detection
5.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
5.4K
Classification of Signals
374
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
374
Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K


