JoVE - Journal of Visualized Experiments
JoVE Visualize
Contact Us

EEG-driven automatic generation of emotive music based on transformer

  • 0School of Computer Science and Artificial Intelligence, Hefei Normal University, Hefei, China.
Frontiers in Neurorobotics +

|

September 3, 2024

|

September 3, 2024

View abstract on PubMed

Summary

This summary is machine-generated.

This study introduces a novel method for emotional music composition using electroencephalography (EEG) data. The approach effectively maps EEG signals to musical elements, enhancing personalized music generation with improved accuracy.

Area Of Science

  • Computational Neuroscience
  • Music Information Retrieval
  • Artificial Intelligence

Background

  • Generating personalized emotional music is challenging due to difficulties in standardizing and mapping continuous electroencephalography (EEG) and audio data.
  • Existing methods struggle with the complex, non-fixed relationship between EEG signals and musical elements like rhythm, melody, and emotion.

Purpose Of The Study

  • To develop a novel method for emotional music composition using deep features from EEG data.
  • To address the challenges of discrete representation and mapping between EEG signals and music data.

Main Methods

  • Utilized clustering algorithms to create discrete representations of EEG and music data, forming a standardized vocabulary.
  • Employed a Transformer model with multi-head attention and positional encoding for reverse mapping of EEG signals to musical elements.
  • Introduced an audio masking prediction loss for improved emotion-driven music generation.

Main Results

  • Achieved a Hits@20 score of 68.19%, a 4.9% improvement over existing methods.
  • Demonstrated effective capture and utilization of temporal and structural relationships in heterogeneous data.
  • Successfully enhanced the understanding of complex internal structures within EEG and audio data.

Conclusions

  • The proposed method offers a robust approach for personalized emotional music composition by effectively leveraging EEG data.
  • The integration of clustering for discrete representation and Transformer models for mapping significantly improves music generation quality.
  • This research highlights the potential of neuro-signal-driven music creation and its advancements.

Keywords:

Related Concept Videos

Types Of Transformers 01:16

954

Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...

The Ideal Transformer 01:26

366

In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...

Generator Voltage Control 01:21

137

Generator voltage control is crucial for maintaining the stable operation of synchronous generators and wind turbines. In older models, a DC generator driven by the rotor delivers DC power to the rotor's field winding, and the power is transferred through slip rings and brushes. In the latest models, static or brushless exciters are used. Static exciters rectify AC power from the generator terminals and then transfer the DC power directly to the rotor. Brushless exciters, on the other hand,...