通过大型多式模式和知识图驱动的处理进行零拍摄医疗图像分类
Xinfu Liu1, Yirui Wu1, Yuting Zhou1
1Key Laboratory of Water Big Data Technology of Ministry of Water Resources, Hohai University, Nanjing 211100, China; College of Computer Science and Software Engineering, Hohai University, Nanjing 211100, China.
Methods (San Diego, Calif.)
|October 15, 2025
概括
本研究引入了使用大型语言模型进行跨模态知识表示 (CMKR) 框架,以改进使用未标记数据进行医学图像分类. CMKR有效地从图像和文本中提取知识,优于现有的方法.
科学领域:
- 人工智能在医学中的应用
- 医疗数据分析 医学数据分析
- 自然语言处理自然语言处理.
背景情况:
- 智能医疗技术已经进步,但处理大量未标记的医疗诊断数据仍然是一个挑战.
- 当前的方法与专业医疗数据作斗争,阻碍了准确的分类任务.
研究的目的:
- 利用大型语言模型来处理大量未标记的医疗数据.
- 提出一个新的框架,用于准确的医学图像分类,使用未标记的数据.
主要方法:
- 开发了一个使用大型语言模型的跨模态知识表示 (CMKR) 框架.
- 从医学图像中提取隐含的知识和使用知识图表的明确文本知识.
- 实施了跨模式调整策略,以加强内部和跨模式知识代表性.
主要成果:
- 拟议的CMKR框架在医疗图像分类任务中表现出卓越的性能.
- 对公共数据集的广泛实验证实了该方法的有效性.
- 这种方法成功地处理了大量未标记的医疗数据.
结论:
- CMKR框架为使用未标记数据进行医学图像分类提供了一个有希望的解决方案.
- 利用大型语言模型和跨模式的知识表示可以显著提高准确性.
- 这种方法促进了人工智能的应用,用于分析复杂的医疗数据.
相关概念视频
Classification of Illness
8.6K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
8.6K
Classification of Systems-I
549
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
549
Aggregates Classification
966
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
966


