两个阶段的unet与封闭的conv融合用于双声音频合成
Wenjie Zhang1, Changjun He1, Yinghan Cao1
1Key Laboratory for Key Technologies of IoT Terminals, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China.
Sensors (Basel, Switzerland)
|April 28, 2025
概括
现在可以更容易地从单声源合成双声音频. 这种新方法有效地重建空间音频,在沉浸式声音体验的阶段估计方面取得了最先进的结果.
科学领域:
- 音频信号处理 音频信号处理
- 人工智能的人工智能
背景情况:
- 双耳音频是沉浸式声音的关键,但捕获成本昂贵.
- 从单声源合成双声音频是一个活跃的研究领域.
研究的目的:
- 提出一种新的两阶段框架,用于从单声源合成双声音频.
- 为了提高双耳音频合成的准确性和效率.
主要方法:
- 一个两阶段的框架,涉及初步的双耳信号转换和组件提取.
- 整合POS-ORI自我注意模块 (POSA) 提供空间和运动信息.
- 使用封闭卷积融合模块 (GCFM) 进行组件重建和最终音频生成.
主要成果:
- 从单声输入中精确合成双声音频.
- 在阶段估计 (阶段-l2:0.789),波段-l2 (0.147) 和振幅-l2 (0.036) 中的最新性能.
结论:
- 拟议的框架为双耳音频合成提供了有效的解决方案.
- 该方法在捕捉和重建空间音频特征方面取得了重大进展.
相关概念视频
The Cochlea
43.8K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
43.8K
Cascaded Op Amps
535
Operational amplifiers (op-amps) are versatile electronic components that can be interconnected in a cascade - one after another in a linear sequence. This cascading is possible due to their infinite input resistance and zero output resistance, allowing them to maintain their input-output relationships even when connected in series.
In a cascaded system, each op-amp is referred to as a stage. The output of one stage drives the input of the subsequent stage. As the input signal passes through...
In a cascaded system, each op-amp is referred to as a stage. The output of one stage drives the input of the subsequent stage. As the input signal passes through...
535
Anatomy of the Ear
7.0K
Auditory sensation, commonly called hearing, involves the transformation of sonic waves into neural impulses facilitated by the structures of the auditory organ. The prominent, flesh-like structure on the side of the head, called the auricle, directs sound waves towards the auditory canal. The auricle is often mislabeled as the pinna, a term more aligned with mobile structures like a feline's external ear. The auditory canal penetrates the cranium via the external auditory meatus of the...
7.0K


