SED++:一个简单的编码解码器,用于改进开放词汇语义分割
相关实验视频
Updated: Jan 12, 2026

06:27
Automated Analysis of C. elegans Fluorescence Images using SegElegans
Published on: October 10, 2025
554
IEEE transactions on pattern analysis and machine intelligence
|October 31, 2025
概括
我们介绍了SED,这是一个用于开放词汇语义细分的编码解码架构,可以使用视觉语言模型高效地分区图像. SED实现了高精度和速度,改善了图像和视频细分任务.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 开放词汇的语义细分需要使用一组开放的类别将图像分成语义区域.
- 目前的方法通常依赖于图像级预训练的视觉语言模型来进行像素级别的细分.
- 需要高效和有效的架构来完成这项任务.
研究的目的:
- 提出SED,一种用于开放词汇语义细分的新型编码解码器架构.
- 利用预训练的视觉语言模型来提高细分性能.
- 通过建筑创新来提高推断效率.
主要方法:
- SED使用层次图像编码器和文本编码器来生成成本体积.
- 一个渐进的融合解码器逐渐整合功能和成本量进行细分.
- 整合了一个类别早期拒绝策略,以过不相关的类别,提高效率.
主要成果:
- 在ADE20K (150个类) 上,SED实现了34.9%的mIoU,并具有快速推理 (69 ms/image).
- 该方法在视频语义细分方面表现出强的表现,在VSPW上达到40.2%的mIoU.
- 实验验证拟议的SED架构的有效性和效率.
结论:
- 对于开放词汇的语义细分,SED提供了一个简单而有效的解决方案.
- 架构的层次设计和早期拒绝策略有助于其性能和效率.
- 对于图像和视频分段任务,SED显示出有希望的结果,并有可能进行进一步的扩展.
相关概念视频
Extraction: Advanced Methods
1.1K
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
1.1K
Encoding
737
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
737
Deconvolution
535
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
535
Classification of Systems-II
452
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
452
Classification of Systems-I
543
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
543
Multi-species Conserved Sequences
4.6K
Next-generation sequencing technologies have created large genomic databases of a variety of animals and plants. Ever since the human genome project was completed, scientists studied the genome of primates, mammals, and other phylogenetically distant living beings. Such large-scale studies have provided new insights into the evolutionary relationship between organisms.
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
4.6K

