创建语音区域与自我分发的声乐群
Malek Itani1, Tuochao Chen2, Takuya Yoshioka3
1Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA. malek@cs.washington.edu.
Nature communications
|September 22, 2023
概括
介绍一个声学群,一种用于声音定位的新系统. 这项技术使用自我分发的麦克风阵列和神经网络来实时分离和定位多个扬声器,创建定义的语音区域.
科学领域:
- 声学信号处理 声学信号处理
- 机器人技术 机器人技术 机器人技术
- 机器学习 机器学习
背景情况:
- 在二维空间中分离并发的语音和确定声音源是一个复杂的挑战.
- 现有的方法通常依赖于摄像头或固定基础设施,限制了灵活性.
研究的目的:
- 开发第一个用于厘米分辨率声音定位和语音分离的声学群.
- 为了实现无需外部硬件的多个并发扬声器的精确的2D空间意识.
主要方法:
- 形成一个自我分发的无线麦克风阵列 (声乐群).
- 使用基于注意力的神经网络框架进行语音分离和本地化.
- 在回声环境中进行现实世界的测试.
主要成果:
- 成功地定位和分离3-5个并发的语音源.
- 中位数和90百分点的二维定位误差分别为15厘米和50厘米.
- 展示了使用声音的厘米分辨率合作导航.
结论:
- 声波群为分离和定位多个扬声器提供了一个无摄像头的解决方案.
- 启用新型应用程序,如静音区,主动区和位置感知交互.
相关概念视频
Sound Waves: Interference
3.8K
Sound waves can be modeled either as longitudinal waves, wherein the molecules of the medium oscillate around an equilibrium position, or as pressure waves. When two identical waves from the same source superimpose on each other, the combination of two crests or two troughs results in amplitude reinforcement known as constructive interference. If two identical waves, that are initially in phase, become out of phase because of different path lengths, the combination of crests with troughs...
3.8K
Interference: Path Lengths
1.3K
Consider two sources of sound, that may or may not be in phase, emitting waves at a single frequency, and consider the frequencies to be the same.
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
1.3K
Hybrid Zones
17.1K
Hybrid zones are narrow regions where two closely related species interact, mate, and produce hybrids. Relative to either parent species, hybrids may possess distinct phenotypic or genetic differences that impact their survival and reproductive success. The genetic variances introduced by hybridization influence species diversity and speciation processes within the hybrid zone.
17.1K
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Sound as Pressure Waves
2.4K
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
The pressure fluctuation depends on the difference in displacements between the successive points in the...
2.4K
Echo
532
The human ear cannot distinguish between two sources of sound if they happen to reach within a specific time interval, typically 0.1 seconds apart. More than this, and they are perceived as separate sources.
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case,...
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case,...
532


