通过知识蒸视觉语言模型自动生成皮肤癌报告
Lawhori Chakrabarti1, Boyu Zhang1, Hengyi Tian1
1Department of Computer Science, University of Idaho, Moscow, ID 83844, USA.
IEEE access : practical innovations, open solutions
|September 19, 2025
概括
人工智能 (AI) 现在可以从皮肤镜图像中生成详细的皮肤癌诊断报告. 这一突破提高了透明度,并减少了皮肤病学中临床医生的工作负担.
科学领域:
- 皮肤病学 皮肤病学
- 人工智能的人工智能
- 医疗成像医学成像
背景情况:
- 人工智能 (AI) 在分析皮肤镜图像以诊断皮肤癌方面表现有前途.
- 人工智能诊断工具缺乏透明度和可解释性,阻碍了临床采用.
- 自动化报告生成可以提高AI的解释性,并减少医疗专业人员的工作量.
研究的目的:
- 开发一种多式视觉语言模型 (VLM) 来从皮肤镜图像中生成结构化的医疗报告.
- 提高人工智能驱动的皮肤病诊断的解释性和临床实用性.
- 通过自动化报告生成,弥合AI能力和临床需求之间的差距.
主要方法:
- 一个两阶段的知识蒸 (KD) 框架被用来培训VLM.
- 该模型生成了分为发现,印象和差异诊断部分的结构报告.
- 报告包含基于7点黑色素瘤检查清单的描述性特征.
主要成果:
- VLM成功地制作了准确和可解释的皮肤病学报告.
- 人类反证实了生成的报告的临床相关性,完整性和可解释性.
- 计算指标 (SacreBLEU,ROUGE-1,ROUGE-L,BERTScore F1) 验证了报告的准确性和对齐.
结论:
- 多式VLM有效地从皮肤镜像中生成结构化,临床相关的报告.
- 该系统的可解释性和概括性能力得到了其设计和验证的支持.
- 这种方法在人工智能辅助的皮肤癌诊断方面取得了重大进展.
更多相关视频
05:33Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
Published on: July 11, 2025
809
09:37Combining Reflectance Confocal Microscopy with Optical Coherence Tomography for Noninvasive Diagnosis of Skin Cancers via Image Acquisition
Published on: August 18, 2022
2.8K
相关概念视频
01:30Skin Cancer
5.7K
Skin cancer is a type of cancer that occurs when there is an abnormal growth of skin cells, usually triggered by damage to the DNA within the skin cells. It is primarily caused by exposure to ultraviolet (UV) radiation from the sun or artificial sources like tanning beds. Skin cancer is the most common type of cancer worldwide, and its incidence continues to rise.
Basal Cell Carcinoma (BCC): BCC is the most common type of skin cancer, accounting for about 80% of cases. It typically develops in...
Basal Cell Carcinoma (BCC): BCC is the most common type of skin cancer, accounting for about 80% of cases. It typically develops in...
5.7K
02:43Mouse Models of Cancer Study
6.4K
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
6.4K