多模式学习可用于可扩展的高维医学数据表示
Areej Alsaafin1, Abubakr Shafique1, Saghir Alfasly1
1Kimia Lab, Department of Artificial Intelligence & Informatics, Mayo Clinic, Rochester, MN, United States.
Frontiers in digital health
|February 13, 2026
概括
MarbliX集成人工智能与数字病理学全幻灯片图像和基因组数据用于精准医学. 这种新的框架增强了患者相似性分析,并优于癌症诊断中的现有方法.
科学领域:
- 计算生物学是一种计算生物学.
- 医疗信息学医学信息学
- 医学中的人工智能.
背景情况:
- 整合多式联络医疗数据,如数字病理全片图像 (WSIs) 和基因组测序,对于精准医学至关重要.
- 当前的诊断模型往往无法利用跨模态相互作用,限制了临床见解.
- 数据模式的异质性和需要可扩展,可解释的框架带来了重大挑战.
研究的目的:
- 引入MarbliX,这是一个自我监督的框架,用于将WSIs和免疫基因组资料嵌入到紧的二进制代码中.
- 为了在统一的潜伏空间中捕捉高分辨率的患者相似性,以便有效地检索和推理病例.
- 为了评估MarbliX在肺癌和癌诊断中的性能.
主要方法:
- 开发了MarbliX,一个自主监督的框架,利用多式联想和检索.
- 采用三重对比的目标,从WSIs和免疫基因组数据中学习嵌入.
- 生成了紧的,可扩展的二进制代码 (单体),用于统一的患者表示.
主要成果:
- 马布利克斯在肺癌中实现了85%-89%的性能,超过了单模式组织病理学 (69%-71%) 和免疫基因组学 (73%-76%).
- 在癌中,实值单图可以达到80%-83%的F1分数,准确率为87%-90%.
- 在癌中,二进制单元图的性能略低 (F1:78%-82%).
结论:
- MarbliX有效地整合了各种数据模式,以进行增强的患者相似性分析.
- 该框架在癌症诊断方面表现出优异的性能,与单模式方法相比.
- MarbliX提供了一个可扩展和可解释的解决方案,用于在精密医学中利用多式联络数据.
相关概念视频
State Space Representation
610
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
610
Graphical Representation of Inequalities
233
The graph of the equation where y equals x squared forms a curve known as a parabola. This curve acts as a boundary in the coordinate plane, dividing it into distinct regions based on the relative position of points.When the equality sign in the equation is replaced with an inequality—such as greater than, less than, greater than or equal to, or less than or equal to—the graphical representation changes from a single curve into a broader shaded area that signifies the set of all...
233
Control Volume and System Representations
1.6K
Two key frameworks are employed to analyze mass, energy, and momentum transfer: the control volume approach and the system approach. These frameworks offer different perspectives, depending on whether the focus is on a specific region in space (control volume approach) or a defined mass of fluid (system approach).
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
1.6K
Vector Representation of Complex Numbers
563
Complex numbers, represented in Cartesian coordinates, can also be visualized as vectors. These vectors can be expressed in polar form, emphasizing their magnitude and angle. When a complex number is input into a function, the output is another complex number, highlighting the function's zero point from which the vector representation can originate.
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
563
Graphical and Analytic Representation of Sinusoids
1000
Analyzing two sinusoidal voltages with equal amplitude and period but different phases on an oscilloscope, an instrument used to display and analyze waveforms, involves a three-step process.
The first step is measuring the peak-to-peak value, which is twice the amplitude of the sinusoid. This provides information about the maximum voltage swing of the waveform.
Secondly, the period and angular frequency are determined. The period is the time taken for one complete cycle of the waveform, while...
The first step is measuring the peak-to-peak value, which is twice the amplitude of the sinusoid. This provides information about the maximum voltage swing of the waveform.
Secondly, the period and angular frequency are determined. The period is the time taken for one complete cycle of the waveform, while...
1000
Inhaled Medications
833
Inhaled medications are crucial for managing chronic obstructive pulmonary disease (COPD) and asthma. They are essential for effective treatment and control, ensuring optimal respiratory health and well-being. Inhaled medication delivers drugs directly to the lungs, providing a rapid onset of action and reducing systemic side effects compared to oral or injectable medications. Three primary types of inhalation devices are used to administer these medications: nebulizers, metered-dose inhalers...
833


