光SAM:灵活的X射线图像分割的语言诱导基础模型
Benjamin D Killeen1, Liam J Wang1, Blanca Iñígo1
1Johns Hopkins University, Baltimore, MD 21218, USA.
概括
使用自然语言提示,FluoroSAM可实现灵活的X射线图像细分. 这种语言对齐的基础模型 (LFM) 通过在多种X射线图像中对解剖结构和工具进行细分来推进精密医学.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 现有的医疗图像分析模型通常是特定任务的,这限制了它们的广泛适用性.
- 语言对齐的基础模型 (LFMs) 显示了自动图像分析的前景,但需要大量的数据.
- 由于外观和应用的高度变化,X射线成像存在独特的挑战.
研究的目的:
- 为全面的X射线图像分析开发一种语言提示型基础模型.
- 为了实现在诊断和干预医学中的灵活的人在循环工作流程.
- 为了解决X射线成像中的数据变化和有限的注释问题.
主要方法:
- 引入了FluoroSAM,这是对300万个合成X射线图像进行训练的Segment-Anything模型的一个变体.
- 包含文本嵌入的矢量量化 (VQ),用于自然语言的快速集成.
- 利用不同的解剖学,成像几何形状和视角,用伪地面真相面具为器官和工具.
主要成果:
- 使用自然语言提示,FluoroSAM成功地从X射线图像中分割了许多解剖结构和工具.
- 在真实X射线数据上证明了定量性能.
- 展示了FluoroSAM在各种应用中的实用性,促进了人机交互.
结论:
- 光SAM推进了语言提示的X射线图像细分.
- 该模型增强了医疗成像中人类循环工作流程的灵活性.
- SAM是改善X射线图像采集和分析的关键推动者.
更多相关视频
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
16.4K
10:39Measurement of X-ray Beam Coherence along Multiple Directions Using 2-D Checkerboard Phase Grating
Published on: October 11, 2016
10.1K
相关概念视频
X-ray Imaging
10.0K
German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...
10.0K
Language
898
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
898
X-ray Crystallography
25.8K
The size of the unit cell and the arrangement of atoms in a crystal may be determined from measurements of the diffraction of X-rays by the crystal, termed X-ray crystallography.
Diffraction
Diffraction is the change in the direction of travel experienced by an electromagnetic wave when it encounters a physical barrier whose dimensions are comparable to those of the wavelength of the light. X-rays are electromagnetic radiation with wavelengths about as long as the distance between neighboring...
Diffraction
Diffraction is the change in the direction of travel experienced by an electromagnetic wave when it encounters a physical barrier whose dimensions are comparable to those of the wavelength of the light. X-rays are electromagnetic radiation with wavelengths about as long as the distance between neighboring...
25.8K
Physiological Foundation of Stress
613
Stress triggers a coordinated physiological response involving the sympathetic nervous system (SNS) and the hypothalamic-pituitary-adrenal (HPA) axis. This dual activation ensures that the body is prepared for both immediate and prolonged stress management. The process begins with the perception of a stressor. This initial phase activates the SNS, leading to the rapid release of adrenaline (epinephrine) from the adrenal glands.
Role of the Sympathetic Nervous System
Adrenaline triggers the...
Role of the Sympathetic Nervous System
Adrenaline triggers the...
613
Social Foundations of Self II: The Generalized Other
243
According to George Herbert Mead, as children progress beyond the game stage, they develop a more comprehensive understanding of societal rules and norms. This cognitive and social development enables them to internalize the expectations of the broader community, refining their ability to regulate behavior.Consistent participation in organized activities is crucial in helping children recognize that their actions are not isolated but contribute to a more significant, interconnected group...
243
Theoretical Foundations of Nursing Practice
17.3K
Theories play an essential role in organizing patient care. Theories refer to a proposed or followed belief, policy, or procedure that is the basis for action. Nursing theories are knowledge-based concepts that guide nurses' actions, influence nursing education and practice, and allow nurses to care for their patients.
Theories provide a perspective to assess patients' conditions and organize data and methods. They also assist in analyzing and interpreting information. They represent a...
Theories provide a perspective to assess patients' conditions and organize data and methods. They also assist in analyzing and interpreting information. They represent a...
17.3K
