耳LLM:通过EEG-fMRI融合学习进行耳诊断的多式大型语言模型框架
IEEE journal of biomedical and health informatics
|March 3, 2026
概括
这项研究介绍了TinnitusLLM,一种新的多式大型语言模型 (LLM),通过整合脑电图 (EEG) 和功能磁共振成像 (fMRI) 数据来诊断耳. 与现有方法相比,TinnitusLLM显著提高了诊断准确度.
科学领域:
- 神经科学是一个神经科学.
- 人工智能的人工智能
- 医学诊断 医学诊断 医学诊断
背景情况:
- 准确的耳声诊断对于有效的治疗和监测至关重要.
- 目前的诊断方法依赖于脑电图 (EEG) 或功能磁共振成像 (fMRI) 的单模分析,限制了精度.
- 整合来自EEG和fMRI的互补神经特征可以增强诊断能力.
研究的目的:
- 推出TinnitusLLM,这是首个多式大型语言模型 (LLM) 框架用于耳诊断.
- 为了协同整合EEG和fMRI功能,提高诊断准确度.
- 为客观的耳评估制定一个临床上可行的框架.
主要方法:
- 开发了TinnitusLLM,一个多式联络LLM集成EEG和fMRI数据.
- 整合了一个神经启发的定位编码机制,用于神经上接地信号解释.
- 利用多模式自回归预训练和交叉模式对抗性学习,以进行强大的,独立于主体的诊断.
主要成果:
- 与最先进的方法相比,耳LLM显示出更高的跨主体诊断准确性.
- 该框架成功地整合了EEG和fMRI功能来评估耳声.
- 定量评估证实了该模型在多式联运数据集上的有效性.
结论:
- 耳LLM通过利用多模式神经解码,在耳诊断方面取得了重大进展.
- 该框架显示了在临床环境中客观评估耳的潜力.
- 多模式LLM为改善神经疾病的诊断精度提供了一个有希望的方向.
相关概念视频
Imaging Studies for Cardiovascular System V: CT
Cardiac computed tomography (CT) scanning is an advanced cardiac imaging technique that utilizes CT technology, with or without intravenous (IV) contrast, to produce accurate cross-sectional virtual slices of specific areas of the heart, coronary circulation, and major blood vessels such as the aorta, pulmonary veins, and arteries. The computer processes these slices to generate three-dimensional images. Multidetector CT (MDCT) is a rapid form of CT scanning that captures multiple slices...
Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT
Calcium-Scoring CT ScanA calcium-scoring CT scan, also known as coronary artery calcium (CAC) scan, detects calcium deposits in the coronary arteries. This test assesses the risk of coronary artery disease (CAD), which can lead to cardiovascular events such as angina, heart failure, and sudden cardiac arrest.A calcium-scoring CT scan is generally recommended for individuals at intermediate risk of CAD without symptoms. It includes:Men aged 40-75 and women aged 50-75: Especially those with a...
Imaging Studies III: Computed Tomography
DefinitionComputed Tomography (CT) of the genitourinary (GU) tract is a non-invasive imaging modality that utilizes X-rays and computer processing to generate detailed cross-sectional images of the urinary system, encompassing the kidneys, ureters, bladder, and adjacent structures such as the adrenal glands.PurposeCT scans of the GU tract serve several diagnostic and therapeutic purposes, including:Diagnosis of Urinary Tract Diseases: Detects kidney stones, tumors, cysts, and congenital...
Imaging Studies VII: Vascular Imaging
DefinitionRenal angiography, also known as renal arteriography, is an imaging technique used to obtain a comprehensive view of blood flow and the vascular structure of blood vessels in the kidneys and surrounding areas.PurposeRenal angiography detects blood vessel abnormalities in the kidneys, such as aneurysms, stenosis, thrombosis, vascular tumors, and renal artery stenosis. It evaluates kidney function and guides interventional treatments like angioplasty or stent placement.Pre-Procedure...


