从人类的fMRI中重建自然图像,使用三阶段的多层次深度融合模型
Lu Meng1, Zhenxuan Tang1, Yangqian Liu2
1School of Information Science and Engineering, Northeastern University, Shenyang 110819, China.
Journal of neuroscience methods
|September 2, 2024
概括
本研究介绍了一种三阶段的多层次深度融合模型 (TS-ML-DFM),用于从fMRI数据中改进大脑视觉模式的重建. 这种新的深度学习方法显著提高了重建的准确性,推进了大脑解码研究.
科学领域:
- 神经科学是一个神经科学.
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 图像重建对于使用fMRI数据对大脑解码至关重要.
- 有限的fMRI样本往往导致重建质量差.
研究的目的:
- 开发一个先进的深度学习模型,以增强基于fMRI的图像重建.
- 克服大脑解码研究现有方法的局限性.
主要方法:
- 提出了一个三阶段的多层次深度聚变模型 (TS-ML-DFM).
- 整合了来自深度和原始图像的补充功能.
- 使用的组件包括图像编码器,发电机,区分器,fMRI编码器,随机转移,双重注意力和多级特征融合模块.
主要成果:
- 在Horikawa17和VanGerven10数据集上取得了出色的性能.
- 在各种指标 (例如,直方图相似性为3.62%,SwaV语义指标为10.53%) 中,与领先方法相比,表现出显著的定量改进.
结论:
- 使用fMRI数据,TS-ML-DFM方法显著优于以前用于解码大脑视觉模式的算法.
- 这一进步促进了大脑解码研究的进一步进展.
相关概念视频
Magnetic Resonance Imaging
7.6K
Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...
7.6K
Brain Imaging
1.0K
Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
1.0K


