一个改进的ViT模型用于基于mel谱图的音乐类型分类
Pingping Wu1, Weijie Gao2, Yitao Chen2
1Jiangsu Key Laboratory of Public Project Audit, School of Engineering Audit, Nanjing Audit University, Nanjing, China.
PloS one
|March 13, 2025
概括
本研究介绍了一种改进的视觉变压器 (ViT) 模型,用于自动化音乐类型分类. 改进的模型在GTZAN数据集上达到86.8%的准确性,改善了从Mel光谱图中提取特征.
科学领域:
- 人工智能的人工智能
- 音乐信息检索 音乐信息检索
- 机器学习 机器学习
背景情况:
- 自动音乐类型分类对于增强用户体验和管理音乐库至关重要.
- 现有的方法可能无法完全捕捉音乐音频信号中的复杂特征.
研究的目的:
- 为更准确的音乐类型分类提出一个改进的视觉变压器 (ViT) 模型.
- 通过结合卷积神经网络 (CNN) 和变压器来增强来自Mel光谱的特征提取.
- 使用通道注意力机制来提高分类精度.
主要方法:
- 使用了改进的视觉变压器 (ViT) 架构.
- 集成卷积神经网络 (CNN) 与变压器用于特征提取.
- 整合了一个频道注意力机制,以放大Mel光谱图中的频道间差异.
- 在GTZAN数据集上对模型进行了评估.
主要成果:
- 拟议的模型在GTZAN数据集上实现了86.8%的准确性.
- 与以前的方法相比,在提取全面的音乐类型特征方面表现出卓越的表现.
- 道注意力机制有助于更精确的分类.
结论:
- 改进的ViT模型为音乐类型分类提供了更准确,更有效的方法.
- 这种方法提高了理解和分类各种音乐类型的能力.
- 这些发现为音乐信息检索系统的进步铺平了道路.
相关概念视频
Classification of Signals
369
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
369
Mass Spectrum: Interpretation
1.1K
An unknown compound can be established by identifying the molecular ion peak in the mass spectrum. The molecular ion peak is often weak or absent due to the predominance of fragmentation in high-energy electron beams. In such cases, a low-energy electron beam can be used to scan the spectrum to enhance the intensity of the molecular ion peak. Additionally, chemical ionization, field ionization, and desorption ionization spectra are used to obtain a relatively intense molecular ion peak.
To...
To...
1.1K
Perception of Sound Waves
4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K
Perceiving Loudness, Pitch, and Location
176
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
176
Determination of Expected Frequency
2.1K
Suppose one wants to test independence between the two variables of a contingency table. The values in the table constitute the observed frequencies of the dataset. But how does one determine the expected frequency of the dataset? One of the important assumptions is that the two variables are independent, which means the variables do not influence each other. For independent variables, the statistical probability of any event involving both variables is calculated by multiplying the individual...
2.1K
¹³C NMR: Distortionless Enhancement by Polarization Transfer (DEPT)
993
When proton-coupled carbon-13 spectra are simplified by a broadband proton decoupling technique, structural information about the coupled protons is lost. Distortionless enhancement by polarization transfer (DEPT) is a technique that provides information on the number of hydrogens attached to each carbon in a molecule. While the DEPT experiment utilizes complex pulse sequences, the pulse delay and flip angle are specifically manipulated. The resulting signals have different phases depending on...
993


