一个多式视觉基础模型用于临床皮肤病学
Siyuan Yan1,2, Zhen Yu1, Clare Primiero3
1AIM for Health Lab, Faculty of Information Technology, Monash University, Melbourne, Victoria, Australia.
Nature medicine
|June 6, 2025
概括
一个新的多式人工智能模型PanDerm通过整合来自多种成像类型的数据来显著提高皮肤疾病的诊断和治疗. 这种先进的人工智能方法实现了最先进的结果,改善了临床医生的早期黑色素瘤检测和整体诊断准确性.
科学领域:
- 人工智能在医学中的应用
- 皮肤病学 皮肤病学
- 医学成像分析 医学成像分析
背景情况:
- 诊断皮肤疾病需要先进的视觉技能和多式联络数据合成.
- 目前的深度学习模型在解决临床皮肤病学的复杂,多模式性质方面是有限的.
- 需要人工智能模型,可以整合多种成像模式,进行全面的皮肤病学评估.
研究的目的:
- 介绍PanDerm,皮肤病学的多式基础模型.
- 评估PanDerm在广泛的皮肤病学任务中的表现.
- 评估PanDerm对医疗保健提供者的诊断能力的临床效用和影响.
主要方法:
- 在使用超过200万个真实世界皮肤疾病图像的自我监督学习中进行了PanDerm的预训练.
- 该模型通过11个临床机构的数据在4种成像模式中进行训练.
- 对28个不同的基准进行了绩效评估,包括查,诊断,细分和预后.
主要成果:
- 在所有28个评估任务中,PanDerm实现了最先进的性能.
- 该模型经常超过现有方法,即使具有有限的标记数据 (10%).
- 读者研究证明了PanDerm在早期黑色素瘤检测,诊断准确性和差异诊断支持方面的优势.
结论:
- 在各种临床皮肤病情景中,PanDerm显示出改善患者护理的巨大潜力.
- 该模型的多式联络方法为开发其他医疗专业的基础模型树立了先例.
- 在加快AI驱动诊断支持在医疗保健中的整合方面,PanDerm显示出有前途.
相关概念视频
Changes in Skin Color: Clinical Perspectives
2.3K
The first thing a clinician sees is the skin, so the examination of the skin should be part of any thorough physical examination. Most skin disorders are relatively benign, but a few, including melanomas, can be fatal if untreated. A couple of the more noticeable disorders, albinism and vitiligo, affect the appearance of the skin and its accessory organs.
Albinism
Albinism is a genetic disorder that affects (completely or partially) the coloring of skin, hair, and eyes. The defect is primarily...
Albinism
Albinism is a genetic disorder that affects (completely or partially) the coloring of skin, hair, and eyes. The defect is primarily...
2.3K
Confocal Fluorescence Microscopy
14.6K
Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
14.6K
Skin Cancer
4.6K
Skin cancer is a type of cancer that occurs when there is an abnormal growth of skin cells, usually triggered by damage to the DNA within the skin cells. It is primarily caused by exposure to ultraviolet (UV) radiation from the sun or artificial sources like tanning beds. Skin cancer is the most common type of cancer worldwide, and its incidence continues to rise.
Basal Cell Carcinoma (BCC): BCC is the most common type of skin cancer, accounting for about 80% of cases. It typically develops in...
Basal Cell Carcinoma (BCC): BCC is the most common type of skin cancer, accounting for about 80% of cases. It typically develops in...
4.6K
Photoreceptors and Visual Pathways
6.5K
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category,...
6.5K


