通过局部增强型变压器网络加速高质量的拉曼成像
Shizhuang Weng1,2, Rui Zhu1,2, Yehang Wu1,2
1National Engineering Research Center for Agro-Ecological Big Data Analysis & Application, Hefei 230601, China.
The Analyst
|November 16, 2023
概括
这项研究引入了一个新的深度学习模型,即局部增强的变压器网络 (LETNet),以显著加快拉曼成像 (RI). LETNet 能够为医疗应用提供更快,更高质量的分子诊断.
科学领域:
- 生物医学光学 生物医学光学
- 医学成像医学成像
- 计算病理学计算病理学
背景情况:
- 拉曼成像 (RI) 提供了分子水平的诊断信息,但受到长时间采集时间的限制.
- 基于深度学习的超级分辨率 (SR) 提供了一个解决方案来加速RI.
- 现有的SR方法在RI的效率和细节保存方面面临挑战.
研究的目的:
- 为拉曼图像超分辨率开发一个高效的深度学习模型.
- 为了缩短获得高质量的拉曼成像的采集时间.
- 提高RI在时间敏感的医学诊断中的应用性.
主要方法:
- 为Raman image SR.提出了一个局部增强的变压器网络 (LETNet).
- 修改了变压器架构,将自我注意力用卷积替换为高保真图像生成.
- 使用深度智能卷积优化卷积,以提高计算效率.
主要成果:
- 在乳腺癌细胞和脑瘤组织上,LETNet实现了卓越的2×,4×和8×SR性能.
- 与其他SR方法相比,该模型在较少的参数中证明了有效性.
- 实现了显著的时间缩短 (4×到64×) 以获得高质量的拉曼图像.
结论:
- 莱特网提供了一种高效可靠的方法来加速高质量的拉曼成像.
- 拟议的方法可以显著减少图像采集时间,促进实时诊断应用.
- 莱特网推进了拉曼成像在细胞病理学和细胞病理学中的实用性.
相关概念视频
Raman Spectroscopy Instrumentation: Overview
429
A conventional Raman spectrophotometer includes a laser source, a sample holding system, a wavelength selector, and a detector.
The monochromatic laser source, typically using visible or near-infrared radiation, generates a highly focused beam of light. This light interacts with the molecules of the sample, scattering some of the light. Liquid and gaseous samples are usually tested in ordinary glass capillaries, while solids can be analyzed as powders packed in capillaries or as potassium...
The monochromatic laser source, typically using visible or near-infrared radiation, generates a highly focused beam of light. This light interacts with the molecules of the sample, scattering some of the light. Liquid and gaseous samples are usually tested in ordinary glass capillaries, while solids can be analyzed as powders packed in capillaries or as potassium...
429
Raman Spectroscopy: Overview
415
The underlying principle of Raman spectroscopy is based on the interaction between light and matter, specifically molecules' inelastic scattering of photons. When a monochromatic beam of light, typically from a laser source, interacts with a sample, most scattered light has the same frequency as the incident light. This is known as Rayleigh scattering.
However, a small fraction of the scattered light exhibits a frequency shift due to the exchange of energy between the incident photons and...
However, a small fraction of the scattered light exhibits a frequency shift due to the exchange of energy between the incident photons and...
415
Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K


