提高零射击多标签内镜仪器分类中的概括性
Raphaela Maerkl1, Tobias Rueckert2,3, David Rauber2
1Regensburg Medical Image Computing (ReMIC), OTH Regensburg, 93053, Regensburg, Germany. raphaela.maerkl@st.oth-regensburg.de.
概括
改善医疗AI的零射击学习,本研究使用句子嵌入和z-score正常化来增强未见的手术仪器的识别,显著提高准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 医疗成像医学成像
背景情况:
- 神经网络难以将其推广到看不见的类,这是安全关键医疗应用中的一个关键问题.
- 零射击学习 (ZSL) 通过利用语义数据提供解决方案,但性能取决于嵌入质量.
研究的目的:
- 调查ZSL在医疗图像识别中的完整描述性句子嵌入与简单单词嵌入的有效性.
- 评估z-score规范化对未见类嵌入性能的影响.
主要方法:
- 使用 Sentence-BERT 来生成描述性句子嵌入作为类表示.
- 将句子嵌入与BERT衍生的词嵌入进行比较.
- 应用z-score规范化作为后处理步骤.
- 在多标签的通用零射击学习任务上进行评估,用于内镜图像中的手术仪器识别.
主要成果:
- 将句子嵌入与z分数正常化相结合,显著提高了未见类的性能.
- 接收器操作特征曲线 (AUROC) 下面的面积,未见的类从43.9%增加到64.9%.
- 不见类的多标签精度从26.1%上升到79.5%.
结论:
- 句子嵌入和z-score规范化大大提高了零射击学习模型的概括能力.
- 拟议的方法有望提高医疗AI应用中的可靠性.
- 建议在不同的数据集和领域进行进一步验证,以确认可靠性.
相关概念视频
Confocal Fluorescence Microscopy
Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
Mass Spectrum: Interpretation
An unknown compound can be established by identifying the molecular ion peak in the mass spectrum. The molecular ion peak is often weak or absent due to the predominance of fragmentation in high-energy electron beams. In such cases, a soft-energy electron beam can be used to scan the spectrum to enhance the intensity of the molecular ion peak. Additionally, chemical ionization, field ionization, and desorption ionization spectra are used to obtain a relatively intense molecular ion peak.To...
Mass Analyzers: Overview
The mass analyzer is a crucial component of the mass spectrometer. In the ionization chamber, the vaporized sample is bombarded with a high-energy electron beam to generate a radical cation and further fragment into neutral molecules, radicals, and cations. A series of negatively charged accelerator plates accelerate the cations into the mass analyzer. The mass analyzer separates ions according to their mass-to-charge (m/z) ratios and then directs them to the detector. The common types of mass...
Mass Analyzers: Common Types
The quadrupole mass analyzer consists of four cylindrical metal rods arranged in a diamond carrying a DC voltage and a radio-frequency AC voltage. The motion of ions through the quadrupole depends on the field strength, causing only ions of a certain m/z to resonate successfully and strike the detector at a given field strength. Though the transmission rate for these analyzers is high, the exact elemental composition of the sample is not determined because of low resolution; however, they are...
Tandem Mass Spectrometry
Tandem mass spectrometry is a technique that uses multiple mass analyzers in series to obtain a higher selectivity and reduce chemical noise during analyte detection. Instruments with multiple analyzers separated by an interaction cell enable secondary fragmentation and selected study of the fragment ions.Secondary fragmentations occur in the interaction cell and can be induced by various factors. Fragmentation induced by collision with inert gases, such as N2, Ar, He, etc., is called...


