统一的多模式诊断框架与重建预训练和异质战斗调整
IEEE journal of biomedical and health informatics
|April 2, 2024
概括
这项研究引入了统一医疗多模式诊断 (UMD) 框架,以改善计算机辅助诊断. 该UMD框架增强了预培训和下游调整策略,以应对医疗多模式学习中的数据异质性挑战.
科学领域:
- 人工智能在医学中的应用
- 医疗信息学 医疗信息学
- 计算机辅助诊断 计算机辅助诊断
背景情况:
- 医学多模式预培训显示了使用大型未标记数据集进行计算机辅助诊断的潜力.
- 现有的蒙面自动编码方法缺乏高级语义信息,并与数据和模式异质性作斗争.
研究的目的:
- 提出统一的医疗多模式诊断 (UMD) 框架,以加强医疗多模式预培训和下游调整.
- 解决医疗诊断任务中的分布和模式异质性挑战.
主要方法:
- 开发了一个多层次的重建预训练 (MR-Pretrain) 战略,用于特征级和数据级的重建.
- 引入了以任务为导向的分布校准 (TD-Calib) 和梯度引导的模式协调 (GM-Coord) 的异质性打击下游调整策略.
主要成果:
- 在五个公共医疗数据集中,UMD框架表现出卓越的性能.
- 提出的预培训和调整策略有效地捕获语义信息,并管理数据异质性.
结论:
- 在医疗多式联络诊断任务中,UMD框架显著优于现有方法.
- 量身定制的策略提高了预先训练的知识向下游应用的可转移性,提高了诊断准确性.
更多相关视频
05:41Author Spotlight: Integrating Ultrasound Imaging with Biochemical Markers for Thyroid Disease Diagnosis
Published on: February 9, 2024
599
02:09Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
587
相关概念视频
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106
Improving Translational Accuracy
10.3K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.3K
