关于特定领域视觉语言模型在查乳房镜中的转移学习行为
Aisha Urooj Khan1, Gokul Ramasamy2, Muhammad Danish Khan3
1AI Innovation Hub, Mayo Clinic, Phoenix, AZ, USA.
Journal of biomedical informatics
|January 24, 2026
概括
适用于乳房镜的特定领域视觉语言模型 (VLM) 优于标准模型. 基于知识的VLM骨干与冷重量显示在组织密度估计和BI-RADS预测中表现优异,即使数据有限.
科学领域:
- 放射学 放射学是一门学科.
- 医疗成像医学成像
- 人工智能的人工智能
背景情况:
- 传统的视觉语言模型 (VLMs) 由于解剖学同质性,高图像尺寸和不平衡的数据集,难以处理放射性数据.
- 适应VLM对于推进乳房影像医学图像分析至关重要.
研究的目的:
- 为了适应特定领域的VLM图像编码器用于2D乳房图分析.
- 评估乳房学术任务的转移学习策略.
- 将性能与现有模型和监督基线进行比较.
主要方法:
- 图像编码器的经验性适应来自特定领域的VLMs.
- 应用于两个下游任务:组织密度估计和BI-RADS预测.
- 转移学习技术:线性探测,微调和在线自蒸.
主要成果:
- 基于知识的特定领域的VLM骨干与结的权重超过了MammoClip VLM和监督的基线 (ViT,CNN).
- 即使只有5%的培训数据,也观察到更高的表现.
- 在两个外部数据集上验证了通用化功能.
结论:
- 域特定的VLM骨干为乳房图分析提供了一种强大的方法.
- 结重量,知识驱动的VLM骨干显示出高效率和有效性,特别是在有限的数据.
- 适应的VLM显示了对现实世界放射应用的有希望的概括性.
相关概念视频
Vision
59.5K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.5K
Language
898
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
898
Conservation of Protein Domains Over Different Proteins
14.1K
Protein domains are small structurally independent units that are part of a single amino acid chain. Although these domains are often structurally independent, they may rely on synergistic effects to perform their functions as part of a larger protein. Protein domains may be conserved within the same organism, as well as across different organisms.
A limited set of protein domains often duplicate and recombine during evolution. These domains can be organized in different combinations to...
A limited set of protein domains often duplicate and recombine during evolution. These domains can be organized in different combinations to...
14.1K
Color Vision
1.4K
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
1.4K
Components of Language
803
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
803
Language Development
879
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
879


