MCV-UNet:一个修改的卷积和变压器混合编码器-解码器网络,具有用于超声波图像语义细分的多尺度信息融合
1Department of Mechanical Engineering, Columbia University, New York, United States of America.
PeerJ. Computer science
|July 10, 2024
概括
这项研究介绍了一种混合深度学习网络,将卷积神经网络 (CNN) 和视觉转换器 (ViT) 结合起来,用于优质的超声波图像细分. 这种新的方法显著提高了医学成像应用中的准确性.
科学领域:
- 医疗成像医学成像
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 超声图像的精确语义细分对于医学诊断至关重要.
- 深度学习技术已经推进了超声波图像分析,但在捕获多尺度特征和远程依赖方面仍然存在挑战.
研究的目的:
- 引入一个新的混合网络,集成卷积神经网络 (CNN) 和视觉转换器 (ViT),以增强超声图像语义细分.
- 改进跨多个尺度的特征学习,并在超声波图像中捕捉远程空间依赖.
主要方法:
- 一个混合网络架构,将编码器和解码器中的多尺度CNN与瓶中的视觉变压器 (ViT) 结合起来.
- 在公共基准超声波神经细分数据集上进行了广泛的实验.
- 拟议的方法与现有的17种基准方法进行了基准测试.
主要成果:
- 混合CNN-ViT网络在超声波神经细分任务中超过了所有17种竞争方法.
- 与TransUNet相比,Dice得分提高了4.6%,与Attention UNet相比提高了13.0%.
- 与UNet相比,其精度提高了10.5%,突出显示了卓越的性能.
结论:
- 拟议的混合CNN-ViT网络为超声波成像中的语义细分提供了一种强大的新方法.
- 在统一的框架中将CNN和ViT结合在一起,可以显著增强特征学习,并捕捉复杂的空间关系.
- 这项研究为推进现实世界的医学成像应用提供了巨大的潜力.
相关概念视频
Design Example: Capacitance Multiplier Circuit
1.9K
In integrated circuit technology, a capacitance multiplier is often utilized to produce a larger capacitance value when a small physical capacitance falls short. This is achieved by a circuit that multiplies capacitance values by a factor of up to 1000, such that a 10-pF capacitor can replicate the performance of a 100-nF capacitor.
The circuit illustrated in Figure 1 below incorporates two op-amps, with the first operating as a voltage follower and the second acting as an inverting amplifier.
The circuit illustrated in Figure 1 below incorporates two op-amps, with the first operating as a voltage follower and the second acting as an inverting amplifier.
1.9K
Deconvolution
776
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
776


