相关实验视频
Updated: Jul 12, 2025

04:47
Olfactory Context Dependent Memory: Direct Presentation of Odorants
Published on: September 18, 2018
6.6K
通过视觉模式通过对象声音启用视觉对象检测,回忆内存
IEEE transactions on neural networks and learning systems
|October 19, 2023
概括
这项研究介绍了一种基于声音的新型物体探测器,可以模仿人类的听觉视觉整合. 该系统使用视觉模式回忆 (VMR) 存储器仅使用声音来检测物体,推进了传统的仅视觉方法.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 传统的对象检测严重依赖于视觉数据.
- 人类对象识别集成了听觉和视觉信息.
- 在基于声音的物体检测系统中存在一个缺口.
研究的目的:
- 开发一种基于声音的新型物体探测器.
- 模仿人类的听觉视觉集成用于对象检测.
- 为了使物体检测只使用声音输入.
主要方法:
- 设计了一种视觉模式回忆 (VMR) 存储器,从音频输入中检索视觉信息.
- 建议VMR丢失和视听关联丢失来训练VMR内存.
- 使用回忆视觉信息和原始音频实现了视听集成.
- 引入了集成功能对比损失,以增强功能嵌入.
主要成果:
- 拟议的基于声音的物体检测器有效地使用仅声音进行物体检测.
- 实验结果验证了VMR内存的有效性和拟议的损失.
- 该方法展示了超越传统的仅视觉对象检测的新视角.
结论:
- 这种基于声音的新型物体探测器成功地利用听觉信息进行物体识别.
- VMR内存和相关的损失对于回忆和整合跨模式信息至关重要.
- 这项研究通过将声音作为主要输入,在物体检测方面取得了重大进展.
相关概念视频
Eyewitness Memory
114
Eyewitness memory refers to the recollection of events by someone who has directly witnessed them, often serving as critical evidence in legal settings. This type of memory is commonly used in criminal cases where a witness describes details like a suspect's appearance, clothing, or behavior during a crime. However, despite its perceived reliability, eyewitness memory is prone to significant errors.
One such error is memory distortion, which occurs because human memory does not function...
One such error is memory distortion, which occurs because human memory does not function...
114
Visual Agnosia
210
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
210
Sensory Memory
226
Sensory memory captures information from the environment in its original form for a very brief duration, just long enough to be exposed to visual, auditory, and other senses. This type of memory is detailed and rich but quickly lost unless certain strategies are employed to transfer it into short-term or long-term memory. Sensory information is continuously bombarding the human brain, yet only a small fraction is absorbed, as most of it does not significantly impact daily life. For instance,...
226
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Auditory Perception
343
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
343
Implicit Memories
135
Implicit memories, also known as non-declarative memories, are long-term memories that function outside of conscious awareness. These memories influence behavior and skills without explicit knowledge. This type of memory is evident in tasks like playing tennis, snowboarding, and texting. Implicit memory has three subsystems: procedural memory, conditioning, and priming. This type of memory is essential in various activities, from everyday tasks to specialized skills.
One key aspect of implicit...
One key aspect of implicit...
135

