图像的回声:视觉转换器中的多损失网络用于图像检索
Anshul Pundhir1, Shivam Sagar2, Pradeep Singh3
1Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, 247667, Uttarakhand, India. anshul_p@cs.iitr.ac.in.
Medical & biological engineering & computing
|March 4, 2024
概括
这项研究使用视觉转换器 (ViT) 和一种新的多损失功能来提高图像检索和分类准确度,从而提高皮肤癌诊断.
科学领域:
- 医疗成像医学成像
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 基于内容的图像检索 (CBIR) 对于医学诊断至关重要,特别是在皮肤癌中.
- 使用卷积神经网络 (CNN) 的传统方法在捕捉复杂的图像背景方面存在局限性.
- 视觉转换器 (ViT) 为医疗成像中增强的上下文理解提供了一个有希望的替代方案.
研究的目的:
- 引入一种基于内容的图像检索的新方法,使用视觉转换器 (ViT) 进行皮肤病变分析.
- 开发和验证一个强大的加权多损失函数,以改善特征表示.
- 通过改进图像检索和分类,提高皮肤癌诊断的准确性,特别是黑色素瘤.
主要方法:
- 使用预训练的视觉转换器 (ViT) 来提取图像特征,在上下文理解方面表现优于CNN.
- 开发了一个加权的多损失函数,结合了交叉,三倍和蒸损失.
- 实施了一个双分支网络战略,用于并发的图像检索和分类.
- 通过多数投票进行基于采集的员工分类,以提高诊断预测.
主要成果:
- 在ISIC-2017 (1.01%) 和ISIC-2018 (4.36%) 数据集的平均平均精度 (MAP) 中取得了显著改善.
- 与使用所有损失相比,拟议的多损失函数提高了MAP的6.52% (ISIC-2017) 和3.45% (ISIC-2018).
- 在皮肤病变图像检索和分类方面,在最先进的技术上表现出卓越的性能.
- 通过废除研究和定量/质量分析验证了ViT的有效性和拟议的损失函数.
结论:
- 视觉转换器 (ViT) 与量身定制的加权多损失功能相结合,显著提高了医疗图像检索和分类.
- 拟议的方法提供了一种强大而有效的方法来改善皮肤癌的诊断,特别是黑色素瘤.
- 该研究强调了ViT在医疗AI中的潜力,并为未来的研究提供了可重复的框架.
相关概念视频
01:26Transformers
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
01:16Types Of Transformers
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
01:21Energy Losses in Transformers
In an ideal transformer, it is assumed that there are no energy losses, and, hence, all the power at the primary winding is transferred to the secondary winding. However, in reality, the transformers always have some energy losses, and, hence, the output power obtained at the secondary winding is less than the input power at the primary winding due to energy losses.
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the copper windings...
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the copper windings...
01:27Transformers in Distribution System
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...