LUMINA:语言统一的多式联络印尼语自然音视觉数据集
Eka Rahayu Setyaningsih1,2, Anik Nur Handayani1, Wahyu Sakti Gunawan Irianto1
1Department of Electrical Engineering and Informatics, Universitas Negeri Malang, Semarang Street 5, Malang, 65145, East Java, Indonesia.
Data in brief
|July 4, 2024
概括
LUMINA数据集提供印尼语音视觉语音录音,用于语音感知研究. 本资源有助于理解口语处理和推进语音技术.
科学领域:
- 语言学的语言学.
- 语音感知 语音感知
- 计算机科学 计算机科学
背景情况:
- 语音感知领域需要强大的数据集来分析视听语音线索.
- 现有的数据集可能缺乏特别关注印尼语或多式联运一体化.
研究的目的:
- 引入语言统一多式联通印尼语自然音视觉 (LUMINA) 数据集.
- 为研究印尼语音感知和相关技术提供高质量的资源.
主要方法:
- 策划了一个受限制的视听数据集.
- 收集了来自14名印尼母语 (9名男性,5名女性) 的高质量录音.
- 每位演讲者提供了大约1000个句子,并集中了面部录音.
主要成果:
- 卢米纳数据集包括广泛的印尼语语音视听录音.
- 包括与口语同步的详细面部数据.
- 提供来自多个母语使用者的多样化收藏.
结论:
- LUMINA是研究人类语音感知的一个宝贵资源.
- 促进了印尼语语音识别和合成方面的进步.
- 支持多式联络方法来理解口语处理.
相关概念视频
Lateralization
319
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
319
Auditory Pathway
5.4K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.4K
Light Acquisition
8.4K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.4K
Deconvolution
150
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
150
Intralumenal Vesicles and Multivesicular Bodies
3.4K
Intraluminal vesicles (ILVs) are small vesicles 50-80 nm in diameter formed during the maturation of early endosomes. A specialized endosome containing numerous ILVs is called a multivesicular body (MVB). ILVs contain internalized molecules such as antigens, nucleic acids, proteins, and metabolites. Some of these molecules are released from the MVBs inside exosomes and are transported to other cells. Other MVBs contain molecules that are retained in the ILVs and are later degraded within the...
3.4K
Upsampling
224
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
224


