Mapping multi-modal dynamic network activity during naturalistic music listening.

Area of Science:

• Neuroscience
• Cognitive Science
• Computational Biology

Background:

• The human brain is a complex, adaptive system.
• Understanding the dynamic interplay between brain activity, behavior, and environmental stimuli is crucial for insights into brain function, development, aging, and pathology.
• Modeling multi-stream dynamic data presents significant methodological challenges.

Purpose of the Study:

• To present a novel workflow for analyzing dynamic, multi-modal data integrating brain, behavioral, and stimulus information.
• To demonstrate the application of this workflow using data from a music listening study.
• To address the methodological challenges in modeling complex, real-world brain-behavior interactions.

Main Methods:

• Utilized hidden Markov modeling (HMM) to extract state time series from high-dimensional EEG and stimulus data.
• Estimated time series variables consistent with HMM from low-dimensional behavioral data.
• Employed partial least squares (PLS) to model the integrated multi-modal data.

Main Results:

• Successfully extracted state time series from EEG, stimulus, and behavioral data.
• Modeled the dynamic relationships between brain activity, behavior, and music stimuli.
• Provided a sample interpretation of the results, highlighting the utility of the workflow.

Conclusions:

• The presented workflow offers a viable approach for dynamic multi-modal data analysis.
• Future directions include refining tools and focusing on naturalistic behaviors for enhanced ecological validity.
• This methodology has the potential to advance our understanding of how the brain processes real-world stimuli and adapts.