精确瘤学的视觉语言基础模型
Jinxi Xiang1, Xiyue Wang1, Xiaoming Zhang2
1Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA.
Nature
|January 8, 2025
概括
一个新的AI模型,MUSK,整合了病理图像和临床文本,以改善癌症诊断和治疗预测. 这种多模式方法利用大量数据集来加强临床决策.
科学领域:
- 医学中的人工智能
- 计算病理学
- 医疗信息学
背景情况:
- 临床决策依赖于整合各种数据,如临床笔记和病理学.
- 开发有效的人工智能 (AI) 模型是具有挑战性的,因为没有足够的多模式临床数据集.
- 现有的AI方法难以充分利用成像和文本临床数据中的互补信息.
研究的目的:
- 开发一种新的视觉语言基础模型,具有统一的maSKed建模 (MUSK) 的多式变压器,能够集成大规模的,未标记的,未配对的病理图像和文本数据.
- 在广泛的病理图像和文本数据集上预先训练MUSK,以便有效地对视觉和语言特征进行调整.
- 评估MUSK在广泛的临床应用中所表现的效果,并且需要很少或没有进一步的培训.
主要方法:
- 开发了MUSK视觉语言基础模型,使用统一的面具建模来预训练5000万个病理图像和10亿个文本令牌.
- 此外还预先训练了100万个病理图像-文本对来对准视觉和语言模式.
- 在23个补丁级和幻灯片级的基准测试中测试了MUSK,包括检索,视觉问题回答,分类和结果预测任务.
主要成果:
- 在23个基准测试中,MUSK在图像到文本和文本到图像检索,视觉问题答案和图像分类方面表现出色.
- 在分子生物标志物预测和结果预测方面取得了强有力的结果,包括黑色素瘤复发,泛癌预后以及肺癌和胃食道癌症的免疫治疗反应.
- 有效地整合了病理图像和临床报告的信息,展示了其改善癌症诊断和治疗的潜力.
结论:
- 预先训练的视觉语言基础模型MUSK成功地整合了多模式病理学数据 (图像和文本),用于高级临床应用.
- 通过更好的结果预测,该模型在提高癌症治疗的诊断准确性和精度方面具有显著的前景.
- 马斯克能够利用大规模的,未标记的,未配对的数据,这代表了AI在临床决策中的重大进步.
相关概念视频
Mouse Models of Cancer Study
5.5K
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
5.5K
Combination Therapies and Personalized Medicine
4.8K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
4.8K
Cancer-Critical Genes II: Tumor Suppressor Genes
7.3K
Genes usually encode proteins necessary for the proper functioning of a healthy cell. Mutations can often cause changes to the gene expression pattern, thereby altering the phenotype.
When the function of certain critical genes, especially those involved in cell cycle regulation and cell growth signaling cascades, gets disrupted, it upsets the cell cycle progression. Such cells with unchecked cell cycles start proliferating uncontrollably and eventually develop into tumors.
Such genes that act...
When the function of certain critical genes, especially those involved in cell cycle regulation and cell growth signaling cascades, gets disrupted, it upsets the cell cycle progression. Such cells with unchecked cell cycles start proliferating uncontrollably and eventually develop into tumors.
Such genes that act...
7.3K
Tumor Immunotherapy
472
Immunotherapy is a treatment that boosts or manipulates the immune system to fight diseases, including cancer. For instance, by stimulating an immune response through vaccinations against viruses that cause cancers, like hepatitis B virus and human papillomavirus, these diseases can be prevented. Nonetheless, some cancer cells can avoid the immune system due to their rapid mutation and division. The immune response to many cancers involves three phases: elimination, equilibrium, and escape.
472
Tumor Progression
6.2K
Tumor progression is a phenomenon where the pre-formed tumor acquires successive mutations to become clinically more aggressive and malignant. In the 1950s, Foulds first described the stepwise progression of cancer cells through successive stages.
Colon cancer is one of the best-documented examples of tumor progression. Early mutation in the APC gene in colon cells causes a small growth on the colon wall called a polyp. With time, this polyp grows into a benign, pre-cancerous tumor. Further...
Colon cancer is one of the best-documented examples of tumor progression. Early mutation in the APC gene in colon cells causes a small growth on the colon wall called a polyp. With time, this polyp grows into a benign, pre-cancerous tumor. Further...
6.2K
Cancer Prevention
6.0K
Several factors can increase the risk of cancer in an individual. About 50% of cancer cases can be prevented by adopting a healthy lifestyle, regular exercise, eating healthy, and following a modest cancer prevention diet. Epidemiological studies have consistently shown that populations with vegetable and fruit-rich diets have reduced the incidence of cancer. On the other hand, populations who have a diet rich in animal fat, red meat, junk food, or high calories are predisposed to cancer.
Some...
Some...
6.0K


