梅兰-Dx:一个知识增强的视觉语言框架改善了黑色细胞瘤病理学的差异诊断
Jialu Yao1,2, Songhao Li1,2, Peixian Liang2
1Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA, USA.
NPJ digital medicine
|January 20, 2026
概括
这项研究介绍了Melan-Dx,这是一种AI框架,通过将病理图像与专家知识相结合来增强黑色素瘤诊断. 梅兰-Dx提高了对黑色细胞瘤的分类准确度,帮助皮肤病理学家进行差异诊断.
科学领域:
- 计算病理学计算病理学
- 医学中的人工智能
- 皮肤病学 皮肤病学
背景情况:
- 黑色素瘤是一种致命的皮肤癌,经常被误诊.
- 目前的人工智能模型在对40多种黑色细胞瘤亚型的差异诊断方面扎.
- 皮肤病理学家的诊断推理为AI改进提供了一个模型.
研究的目的:
- 开发一个知识增强的人工智能框架,以改善黑色素瘤差异诊断.
- 用一个精心策划的视觉知识数据库来增强现有的病理学视觉语言模型.
- 在补丁和整个幻灯片图像层面上提高诊断准确性.
主要方法:
- 策划了2893张图像和1102个专家皮肤病理学家的知识条目的多式数据集.
- 开发了"Melan-Dx",一个知识增强的AI框架,利用从精心策划的数据库中检索.
- 增强的冷病理视觉语言模型,而没有微调视觉脊柱.
主要成果:
- 实现了 0.869 准确度的二进制分类和 0.699 顶级-1 准确度的四十类分类.
- 对于少数镜头全幻灯片图像 (WSI) 任务的演示ROC AUC为0.915,对于完全监督的WSI任务的AUPRC为0.925.
- 与现有方法相比,显示了显著的改进,包括高达13.8%的微调模型和23-70.6%的零射击方法.
结论:
- 像Melan-Dx这样的知识增强的人工智能框架可以显著提高计算病理学的基础模型的性能.
- 从精心策划的视觉知识数据库中检索可以增强差异诊断能力,而不需要广泛的模型再培训.
- 梅兰-Dx框架提供了一种有前途的方法来帮助皮肤病理学家准确诊断黑色素瘤.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.4K
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
1.0K
相关概念视频
Vision
59.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.4K
Language
892
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
892
Color Vision
1.4K
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
1.4K
Components of Language
769
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
769
Language Development
867
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
867
Language and Cognition
722
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
722
