类似于MLP的模型,具有卷积复杂转换,用于通过医学图像进行辅助诊断
IEEE journal of biomedical and health informatics
|July 19, 2023
概括
这项研究引入了CCT-MLP模型,用于改进医学图像分析,通过面部和舌头图像增强疾病诊断. 这种新的方法在确定疾病的位置和性质方面实现了卓越的准确性和平均精度.
科学领域:
- 生物医学图像分析
- 医疗保健中的人工智能
- 医学诊断 医学诊断 医学诊断
背景情况:
- 面部和舌头图像对于智能辅助诊断至关重要.
- 这项任务以疾病位置 (DL) 和疾病性质 (DN) 的多标签分类为框架.
- 类似MLP的架构提供了计算效率和概括性,但需要增强的输入功能.
研究的目的:
- 提出一种新的卷积复合转换MLP类型 (CCT-MLP) 模型.
- 改善多标签疾病的位置和自然识别在面部和舌头图像.
- 解决现有的MLP类模型在特征提取方面的局限性.
主要方法:
- CCT-MLP模型集成了一个卷积式tokenizer和卷积层,用于强大的浅特征提取.
- 它使用了道MLP架构,具有复杂的转换,用于深度上下文特征提取.
- 多通道特征被提取并合并用于多标签分类.
主要成果:
- CCT-MLP模型在构建的多标签面部和舌头图像数据集上表现出卓越的性能.
- 实验结果显示,与现有方法相比,精度 (Acc) 和平均精度 (mAP) 显著提高.
- 该方法有效地弥补了传统的MLP结构中的空间信息损失.
结论:
- CCT-MLP模型为生物医学图像分析中的多标签分类提供了一个有希望的方法.
- 它通过使用面部和舌头成像来增强AI系统的诊断能力.
- 拟议的方法代表了基于医学图像的疾病识别的重大进步.
相关概念视频
01:24Convolution: Math, Graphics, and Discrete Signals
296
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
296
01:20Convolution Properties I
184
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
184
01:17Convolution Properties II
236
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
236