相关实验视频

Updated: Jun 19, 2026

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

基于单个麦克风的深层分离,听觉注意力解码,用于竞争的语音和音乐

M Asjid Tanveer¹, Jesper Jensen^1,2, Zheng-Hua Tan¹

¹Department of Electronic systems, Aalborg University, Aalborg, Denmark.

Journal of neural engineering

|April 25, 2025

概括

本研究介绍了一种深度学习系统,用于分离音频源和解码听觉注意力 (AAD),使用单麦克风脑电图 (EEG) 数据. 该系统有效地解码了听到的语音或音乐,即使在复杂的声学环境中.

科学领域:

神经科学是一个神经科学.
信号处理信号处理
机器学习机器学习

背景情况:

听觉注意力解码 (AAD) 旨在从神经信号中识别受理的声音来源.
单个麦克风系统在分离竞争的音频源 (如语音和音乐) 方面面临着挑战.
深度学习在复杂的听觉场景中提供了强大的源分离和AAD的潜力.

研究的目的:

引入一个端到端的深度学习系统,用于使用单通道EEG的源分离和AAD.
评估系统在区分语音和音乐目标和分心器方面的性能.
评估模型在不同的声条件和与头部相关的传递函数 (HRTF) 中的概括能力.

主要方法:

开发了一个深度学习模型,用于直接从混合音频信号中分离源信封.
电脑电图 (EEG) 信号用于深度刺激重建,以皮尔森相关性作为损失函数.
模型在语音/音乐对上进行训练和评估,结合10个HRTF变体来模拟各种头部和耳朵效果.

主要成果:

该系统在原始数据集上实现了82.4%的目标准确性,在HRTF变体中达到75.4%.
干扰器音频实现了0.004的低皮尔森相关性,表明分离成功.
在不同的语音和音乐组合中,AAD准确度仍然很高,性能与完美的源分离相当.

结论:

开发的深度学习模型在各种语音,音乐和HRTF条件中展示了源封面分离和AAD的强烈概括性.
虽然源分离在混合音乐和语音中效率略低,但它不会对AAD性能产生负面影响.
该研究验证了单麦克风深度学习系统在强大的听觉注意力解码方面的潜力.

关键词:

这是一个EEGEEGEEGEEGEEGEEGEEG.听觉注意力听觉注意力深度学习是一种深度学习.与头部相关的转移功能源分离的方法是:演讲和音乐演讲和音乐

更多相关视频

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Published on: July 5, 2015

Recording Brain Activity with Ear-Electroencephalography

Recording Brain Activity with Ear-Electroencephalography

Published on: March 31, 2023

相关概念视频

Auditory Perception

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...

Perceiving Loudness, Pitch, and Location

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...