一个新的生成模型用于医学图像的文字描述,使用转换器与卷积神经网络增强的转换器
Artur Gomes Barreto1, Juliana Martins de Oliveira2, Francisco Nauber Bernardo Gois3
1Graduate Program in Electrical Engineering, Federal University of Ceará, Fortaleza 60455-760, Brazil.
Bioengineering (Basel, Switzerland)
|September 28, 2023
概括
研究人员开发了一种通用生成模型,用于自动医学图像描述,达到0.76准确度. 虽然有前途,但生成的描述可能需要进一步精细化用于临床使用.
科学领域:
- 人工智能的人工智能
- 医疗成像医学成像
- 自然语言处理自然语言处理.
背景情况:
- 自动医学图像描述有助于临床解释.
- 现有的研究缺乏各种模式和客观质量评估的模型.
- 跨医疗条件和图像类型的概括是一个关键的挑战.
研究的目的:
- 开发和评估医疗图像描述的通用生成模型.
- 为了解决在各种图像模式和医疗条件中对模型概括的需求.
- 改善对生成的医学图像描述的客观评估.
主要方法:
- 一种结合自然语言处理和医学图像特征提取的方法论策略.
- 使用基于神经网络的生成模型.
- 专注于实现跨不同图像模式和医疗条件的模型概括.
主要成果:
- 在生成医学图像描述方面有希望的结果.
- 获得了0.7628.8的准确性.
- 获得了0.5387.7的BLEU-1分数.
结论:
- 开发的模型显示了自动医学图像描述的潜力.
- 生成的描述可能会出现语义错误或缺乏细节,表明需要改进的领域.
- 数据的代表性和选择的技术会影响描述的质量.
相关概念视频
Transformers
1.1K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.1K
Magnetic Resonance Imaging
5.2K
Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...
5.2K
Types Of Transformers
1.0K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.0K


