Multi-modal data fusion using source separation: Two effective models based on ICA and IVA and their properties.
Tülay Adali1, Yuri Levin-Schwartz1, Vince D Calhoun2
1Department of CSEE, University of Maryland, Baltimore County, Baltimore, MD 21250, USA.
Proceedings of the IEEE. Institute of Electrical and Electronics Engineers
|November 4, 2015
Summary
This study introduces two advanced methods, Joint Independent Component Analysis (ICA) and Transposed Independent Vector Analysis (IVA), for fusing multi-modal data. These data-driven approaches minimize assumptions, enabling robust feature extraction across diverse datasets.
Area of Science:
- Data Science
- Machine Learning
- Signal Processing
Background:
- Data fusion is crucial for extracting relevant features from multiple datasets.
- Data-driven methods, like Independent Component Analysis (ICA), are vital due to minimal assumptions.
- Independent Vector Analysis (IVA) extends ICA for multi-dataset analysis, exploiting cross-dataset dependencies.
Purpose of the Study:
- To present and compare two multivariate solutions for multi-modal data fusion: Joint ICA and a novel Transposed IVA model.
- To enable full interaction between modalities for estimating underlying features.
- To guide users in selecting appropriate models and parameters for data fusion tasks.
Main Methods:
- Focus on Joint ICA, a model widely used in medical imaging.
- Introduce Transposed IVA as a generalization of multi-set canonical correlation analysis.
- Utilize simulation results to illustrate implementation aspects and model properties.
Main Results:
- Both Joint ICA and Transposed IVA offer distinct decompositions for multi-modal data fusion.
- The study highlights the diversity in decompositions achieved by the two models.
- Implementation details and properties are discussed to aid model selection.
Conclusions:
- Joint ICA and Transposed IVA provide powerful, data-driven solutions for multi-modal data fusion.
- These methods facilitate the extraction of joint features by allowing modalities to interact.
- Understanding model properties and simulation outcomes is key for effective application.
More Related Videos
Related Concept Videos
01:08IR Spectrum Peak Splitting: Symmetric vs Asymmetric Vibrations
2.3K
Identical bonds within a polyatomic group can stretch symmetrically (in-phase) or asymmetrically (out-of-phase). Similar to hydrogen bonding, these vibrations also influence the shape of the IR peak. Generally, asymmetric stretching frequencies are higher than symmetric stretching frequencies. For example, primary amines exhibit two distinct IR peaks between 3300–3500 cm−1 corresponding to the symmetric and asymmetric N-H stretching, while secondary amines exhibit a single...
2.3K
01:14Extraction: Partition and Distribution Coefficients
5.5K
The distribution law or Nernst's distribution law is the law that governs the distribution of a solute between two immiscible solvents. This law, also known as the partition law, states that if a solute is added to the mixture of two immiscible solvents at a constant temperature, the solute is distributed between the two solvents in such a way that the ratio of solute concentrations in the solvents remains constant at equilibrium.
For extracting a solute from an aqueous phase into an...
For extracting a solute from an aqueous phase into an...
5.5K
01:10Reconstruction of Signal using Interpolation
849
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
849
01:20Deconvolution
686
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
686
01:30Classification of Signals
1.6K
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
1.6K
00:56Extraction: Advanced Methods
1.3K
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
1.3K