在安静和噪音中,GaMMA集团的丹麦多态对话与目光语音和运动数据在安静和噪音中
Mark Dourado1,2, Henrik Gert Hassager3, Jesper Udesen4
1GN Advanced Science, Ballerup, Denmark. markacedourado@hotmail.com.
Scientific data
|February 20, 2026
概括
在正常和杂的环境中,GaMMA集体记录了多人丹麦语对话,捕捉了目光,运动和音频数据. 这一数据集有助于研究人类自然交互动态和语音处理.
科学领域:
- 听力学 听力学是指听力学.
- 人与计算机的交互
- 语言学的语言学.
背景情况:
- 了解自然对话,特别是在杂的环境中,对于开发先进的通信技术至关重要.
- 现有的群体往往缺乏同步的多模式数据,限制了对群体相互作用复杂动态的研究.
- 尾酒派对效应对语音感知和源分离提出了重大挑战.
研究的目的:
- 介绍"凝视,运动和多说话者音频 (GaMMA) "集体,这是一个用于研究多语对话的新型数据集.
- 为研究人员提供来自丹麦自然相互作用的全面,同步的多模式数据 (目光,运动,音频).
- 促进关于语音感知,源分离和人类行为在复杂的声学和社会环境中的研究.
主要方法:
- 录制了11组4个丹麦母语的人在自发的,非基于任务的对话中.
- 使用光学跟踪和眼睛跟踪眼镜收集同步的目光和运动数据.
- 使用头戴式和助听器麦克风获取的音频数据,包括处理的信号与噪声减弱和消除交叉声.
主要成果:
- 该GaMMA集体包括原始和处理的视线和音频数据,以及校准和处理细节.
- 从处理的音频信号计算出所有参与者的语音活动.
- 该集体是公开可用于研究目的.
结论:
- 该GaMMA体提供了一个独特的资源,用于调查视觉线索,头部运动和音频在多说话者通信中的相互作用.
- 这一数据集支持了诸如助听器算法,自动语音识别和社交信号处理等领域的进展.
- 该集体的可用性鼓励进一步研究在具有挑战性的听力条件下人类互动的复杂性.
相关概念视频
01:27Language and Cognition
848
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
848
01:28Channels of Non-Verbal Communication
496
Non-verbal communication plays a critical role in human interaction, influencing how individuals perceive emotions and psychological states. It operates through four primary channels: facial expressions, eye contact, body language, and touch. These non-verbal cues help convey meaning beyond spoken language and are often culturally influenced.Facial Expressions and Emotional RecognitionFacial expressions are among the most powerful and universal forms of non-verbal communication. Research has...
496
01:28Automatic Processing and Automatic Social Behavior
279
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
279
01:01Perception of Sound Waves
5.8K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.8K
02:16Light Acquisition
9.7K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
9.7K
01:21Perceiving Loudness, Pitch, and Location
1.1K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.1K